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BACKGROUND QEJa£ imWTIOfii 



This in^'crition u1;n>'5 gt'utisilh to a N\s5ep'> tha? lK'iHta;te<> Ux> i oFeotuxv 

forpermittmg uncxn computes s,^>tiv,aKr 5o m^kc tecdbacj; its to thu content of the 
10 softw3j« wMle tfee software ls ia me is dsscribsd. 



OrganMoa&l leammg systems aste iacospos^ed m sach orgamgatioss ^ schoois, 
which imch students a cmrkuluiR, md basmesses, which teach employees skills. A« 

B orgajskstion^ feeing symm typically fecludes at k«st two basic mles; a fearser md a 
teacher. Th« learner wishes to learn new coacepis, procetes. or other iMomrntio^, The 
teacher ideally wishes k? preses?t the iafermatioa to the kamcr in a way thst best tneets a 
isartJcr's indiv'dual leafmsjg needs. However, it often occurs that the leanxr "stutters" xn 
the leammg process or "Hciw": the ieafj^ef cors^es opos a concept, instructioris, or 

W infonnation ths? he or she doos not understand, either p;:uliaily or coTnpkneiy. It is in the 
teacher':^ Uircresi to kt^oxv which itUyrrnatJon tlic Ictimcr had trouble undersuifjditig, if the 
karaer had uoubie due to the presetriation njethod or sSyk-, and ho<A' the preserited 
information cati be improved to facihtaie icamrng. Once d^e. teacher has obtained &-id 
linderstood these aspects of Ihe taught. mXomsatioa, titc teachtr ca.o chanpc and inaprove Lhs 

B presentation of the sjofommtsofi to mote fully meet the ieatijers* ieatrurtg jseeds and f scjhtiite 
the learning ptx>eess- A critical resource for tte 5eacher to discover how to improve isughi 
iaformation and the learning orgamxatlOB is learner "feedfeacic", which is the infoimation, 
coinments, suggestions, Questions sent from the leanters lo the tether about the taught 
mfortnatioj3. 

3?) The mt^si cs^;cona! ieru-n a!!> .e,„uLif?n;, soit-co-n.'Otuig cs -.elf-* spun a^snn 

Nvstfi-n i.N fijedback. Without fci:di\Kn<. u^e s\ -;te!n is stagixjat, leanjer? t\r sssftr? wisl 
comiuue to have prt>biea^ iear^urig or iniertiicisjg wiihiu th* systeni. -.xt-A havs no way lo 
voice those problems to effect improvetaeuts. I^^arners km-A- which parts of taiigh: 
imbnsittlon gave them the inmt tmabie or cotdd besJ be iBiprt>ved, axid n is c<;sendai in the 




s\ toV^. ij pkxi trns-aviOi to capture 8r<. «r.$h,<, tKi I<?«v3bat,k It tsits*tJij thv ihe 
lean H3„ tux ^oto>*& <-\->fe i -^s n jn 5 c 

products inteifisi p 0 cs'-u < 5c VKsMncf i-il ^ lo of niHii ' 

prod«c*5 aad services aiix^fh reL i ro bo% -WiL it c*> i le t froiD <fs kUis onie 
expencftces of Iho'^e pfodum a»d sen ices, througb cx "to ex tecdb*iv.k Fee^iba^k ^ 
«ecv«5&an for mtemal departmeu s and p ocesses mfbm a bu&mesx 1 'sc mote ctte,.tt\d> 
tb it emplovecs cm Icam a ne'«v p oced«re ot suggest improvemms to ti?r ex^mpie 
nsanufacniang p x)cessvs, the bette ill trt husmes pcrtorm co t itn tlv 

^.i I, ^v m tt, y -^hi^n ne r>r a '^s k. ^ndcr^und tV con n I? t v 

tnwrc ot di^jv-vii u n<.2pK ».r(ixatuiT>pm%t. the coa'-^t, Oi: & s( !.u^ s ) i lih 

^i-jzuK h~t undc'«5taf}d « coftcept a id have hi«i or hfsr ox a ubs*-^ o h o'' hnv^ to hi ae^t 
pnL-5<.nt *he ) ate al It hes-e lea umg needs of t^so Jeajstj *ue 10 aa«-«'-c<i'ieJ u« nr 
feedback, the learner mav become u&ed to sktppmg over difficult concept's gnonng tfeei 
owa questions aboM the concepts s nee those ques,tioj33s arc not answered witkn the 
wvtem Iftheleatse cas provide feedback aboat a course the coar&e cap be m proved 
and the omcome is better tesnsers, 

^rnjtoi »ienK forexampL' iiltsl'njCMMiott e a chips 1 (cU-> n c u H js 
sttware i& be g e«5ted fo opesabd t> r&ha-^^i \ ^-^h Jiu - ormpua m v 
iecdback Product ti i,rs and ten ers can «;e J ftoibavk a h> t pa lixtb o n^aivvn \s )i..h 
c^n g sath ajd develope $ m testmg aad di'veiopmg tho&e proaucts and <5C ce 
%TOilarlv aii> urocsLc*- or*.x©ss servkf js-^ue expenenced M »'5Cf s urn be m prcn ed 
tkOHgh the coli <. n mi i <?n a* feedback 

0. sS*|,jo<,u^' I X in k ^ <.k t \^i, is Hfn«t t^cfs\ upf \ 

a c ri^r ^sxhs (<\ \ii si i i r^^-^Mi Udurs, top jd. 

5 5 *,to ^vt "^M U c vt<»wc llepre&en*- 

H V uion-. nr la,. i-^i'^ro 1. 1 Jt.cdr? t g u g a, a vfr..jrinri' sx s^cn^s 
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ssses the pmMenis in the prior ^ by pmvidiag a ii 
user feedback, A fsedbaci: mterface of the present 
31 a user. A feedback vfewmg mteri*ace of 



t inv^nnon soctiv&s feedback data from t 



^1 to a rev'iewer according to specific preferences of tlie sevsewer. The feedback 
$yv:cni t^f the present msemson collects feedback from asers aad presents feedback to 
J of promatmg ImpfOvemeM i« systems incorporatmg tJbe&e 



of the present myeatio;^ mqukss user feedback 
a specified context or locauoa. The 
feedback iadudes a portmyat of a user commeai abom tbe user's experie-ace^ at the u. erV 
0 k iatetsested in user feedback wtil tjpkaily evaiaate 
All esier feedback mode coxamaad may be activated by fee user t<? pmvide 
md is resjcived, mck as sstecting a 
bmk record IS made. The taftoij or 
c on*e\t E^e inct n a psodiia, process service, ph\s, ui! locauoa ssue, etc referred to 
h (hi ^ i^ik iccajjud ir the feedback 'ocofd V mvj|{jphc?n of attt^ou^e md are 
i h<i use. m i> <.e.evt to qmc' h and ^ $ t r * '\tuj<, thv *£,ed^^^ k 
in \ i mi u,t I rdc^^oa TiiL dtu ■> s.lr ted t ^ ■> iv r t - ^ ss-s 
h f ^ 1 ou J ■Vd.ii lisfrc XV J? Its 1p * 'It la ( ii d< ; 

s'-eo c i^^<jx^u.>^ tht. Iwd^K Kt. > !„ I e 5^ s v » s iha o d 
mdtcatjon tf tbe ph>&jca! ivv u it o us^. art dv hv.^t'f n n l tjs. ^^do' 
comneM^ » ade bv tre tscr latcxa^h < eedhac iud^^ box js h-,->k i-^h h c> 
attnbuk^ 1^0 dut vt. as the attn'>u*e «.ia ana a feedb-itk mcssio, . ^^ xm.r<' d u 
recede o 'imv^^i nptn«* tn>m the mei TU u e cm mpnt tne teedbaJc vvhiU t^^^iut . s\aat 
% <ir V ^' ot dn jCC ax d mvttmxmnts, mdi dmg appi catioa prograxr 



8 mai aal ot ^st wft-ware fbe feedback dialog oox also prefeiably in<.iude a bst of 
prompted tecdback *cts s which are leedbai^k tem^ &i&t have been enteicd b> olher users 
and/or ha\e Ht n entered a < \ Ume% lite bs»t allows a «&c to quickh review and 'select a 
feedback tern li Ji matche*. nis or her o-sv feedback and thm, retnforoe the importance of 
thai ieed^ack netr to tOT o* tbc feedback wstem 



A m&\hod &nd appaif»tm for orjjaistnns and pa-sents g t <.Lt ! <i^k io ^ . 
>Jso deniibvd Ite ieedback «<, oef«n ptcfejabh ..rranc'ijd luio i xi n i <, 
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ieedbsck record , each reoom bexng arranged to cot;ia«si feedback mturuMtioiv retcmng t*^ 
thit iii.e't'h locatsa of coaiexl v^tthm a producs:, pxMC^i^s or service, issue <md a. pluiabrj 
r an^ . ^dt-nftm ih&( ideatif>* the aatiin- oHhe feedback J. tovtdea licmetKxl 
r i. step jdefit *ymg a rev!ewer*<5 v^susljEatsoa p efercoces that mcludc 
? <- a > u J Mbe a ir^;^ lE^' uk-^tstjct!. that fee -evi^w*? dcsjK^s to revicsx : he feedback 
r„. orJ^ ir- t co tsKt-Jod <ii,^.^'a^mce « th the \ ^^x>i\i^it, n r{-k5e'B„e<> to create a 
i. <irt\vjit'4 ^et r^^^n-( *n.t ^cludc h \ h rc. o < ^ »i n . ^ < r-u m hto ^-'ick? 
*>th ;he pff'forcs-ico^ TK njsjiroJ ts r * Ms m% >,« ^-^ ^jsIsc ( oi t'jc uusnK' 

the .c%>cvtJ s •^uaiu'< £ or pfc-'^rcn^.o-v, ''Ltikeruig the tccdb^Ci^ JvLO.^^v in ..aar(«.^--c xv^m 
the changed %'isaa1izatiOJS preferences, md displaying m md c,i^o-> oJ the « m^T ol 
reco ds. m the refsitered combujed set The attribsite sdentjfiet preler^ibH e spayed 1 1 
bar chart fomj m pic chast form, and ars p'iffcrablj' ammgsd into attribute eategonc^, 
wtej just one atlnhute idi uficr in e^ch attribute categssty may be stored in the feedback 
record The bar g aphs mmy be selected or deselected to add or ibubtract, respecu^-eh, 
records that tjclude that pamcalar ^ttrtbute from ^& combmed set of presenter! feedba^v^k 
records The ■vJi^,c^li^>itlo^ preferences Include m sndicatlo of a time rm$& of meicst to 
tne c-\ lev^cf a- d an tn^hca ton of the context of the user in a product, process, or service 
t: at 1"^ ol sntcroN* co tn<? rs. viewer The xrvlewer can al&o prefej^bly select a specific 
fee0^a-{. c--td .^ c?is a ftes^.^i;e coatOEjt stored in the selected feedback reco dad 
dsreoth te^poua n> the feedback 

A tjjeibod and apijaratus far IsBplemestjaf a feeidbssck system including at least otie 
user a»d at least one revsewe %n a computer eisviro'^meai is, al;so descrtbcd. The method 
I ickide- the step of coilectmg a feedback te i frotJi a user while the user is* usj g a 
isofu.arc pto^: Air on a flrsd computer system, where the feedback item mciMdes a comext 
Jovaai>n ot th. uvt wkhm a product, pmce s, or service. The feedback uen ts thct? 
P"ovkicd *o a it^\ic-v\ei x^u h. sxors { cj^n-juSer sv«.*em a^d t^tesert«r. to thc' ev>vet 
vx-idifU'torrx..-ciK^< ' . ^ lrrfrsicouruer,-df ic^icondc^rpmeraic 

wLca .hv; s.sej asM<2)' i<nv is^edb^v^k tcir ^KVe^Mvk .v'tMe*.' ' uc^ Kin 
n\o ( x^'zK-h alH- pioiV.bK stores the tunc ^na phv.Kd \!^>. ioj o5 5X u dxid 

. pj.\ed t .es^i-gc ta«3i tbi, usci Ttte iWbjck rtcoxd - [^re >. 5bh C a | uO< v - 
wkb oihsx teedback records, wfecb are read trom the drr Uvse ,,n^ cscnk 1 b> the 
rcvjc\^'cr by dispiayt g a viewsg lateiface on the second coriip. tor n\ nk j.- Tb^ \ <'s\ nvj 

nie face prrfx'rabh displays bar charts wh'ch each indicate the number of feedback items 
havitif a particular mnbutc A. message content ot ffcxdbac\ nsni\ can alst^ lie displayed 
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vihen the revie^wer seims par tc Jlar ieedbacK tcerr^ fn^ scviw^r v an ptcferaK-v sele^.^ a 
M3bsct ot tcedback itcm^ Vshich axe pK^ciUed txi^ Mi.\^mg tntcrt icc ca« *c 
dsspiav odIv 4. set of feedback ttetm hav paniculaj attjibutt. ui>er ^Ovdtson cotittxt 
aisd/cc tsme of creatioa, 

5 T ^K. prcs^f ' >. i ^ ust, t i \ n o 1 \ is I a i 

sff«rt or nme ajid can sspetifv the mtended memag, the pfees<*e context ^id tl>c 

desued respoase foj the feedback hs&ts tliu& ha\e direct Hiotnauos tor eiiiersis 
teedback Smce users abk to pro% ide teedb^Svk *|Uicy> and conventenUv -i lcame<~ or 
10 other UNcr can bcii^omc more tjsed to qocctiomag p^oWest^ aiid suggest*Bg solutiotis* \ 
learner, tor example, thai, becomes more mtemailv awaa, of hiJ. or her rrr^ninf jjc^d^ and 
the outcome $$ be*ter ieamers tbat -^sli follow throissh v« xth that o% n qaestjons rati c'- Jun 
jgnormg roose amsnom. 

Thv u e tut tiOj r V, * the t m t « S (f io <n hi fXHrfjo a*-" 

o '.("s Js-L ^-tc^or i elf I ^e us(,rs oi th., sv>>t«'^5 f r%Hhtc » ptocc?>s o seniC*. i ^ ^ letd ^ick 
% t ^ i 7u o the picjkcnt imenwn psssents owrsli pattenis m received uner feedback and 
al*-v pjcs.<.aK si^cilic feedback me&sage content from iMn idu^ user*. Tbj? jwewex can 
select to vie^ diffsretst attributes and propertjes. of the feedback as required by the 
M fsyjewers needs. With die ability to ww feedback quKkly, convesietittv^ md SexMv, a 
reviewer cais more easilv draw condtssioM from the feedback and implemeai 
impfovemeats to the provided pt^scess, product or servsce. 



Tbese a«d other S s so s v s or n a ^ t t hi 

skilled m the ari after re* cn^^^, v^iknviiu dN^Kcrtpt on>> and ■^vi ^ U v \ ^li^. u us oi 
2S the drawmsis. 
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.F1G1.1RE j is a biock digram of a computer hypjem 5.ji;t&blc ror use ^vids the 
preseat iaveBtion;; 

FlGUm 2 is a pictorial r&ptemntmxon of s usfsr feedback system of she present 

FIGURES 3a-3d are screen displays of a learner mterface suitable for use with the 
present iav^sntion; 

FIGURE 4 is a .xreen dispky showing the feedback irjterface fof the learner 
imerfacs of Figures 3a- 3d; 

FIGURES 5a-5c aji^ screc55 displays stewing a feedback iatedacs wuh an atmbute 
segment list displayed: 

HGURE 6 is a screes display showing a feedback mterface with a prompted 



FIGURE ? is a screen display showing a feedback interface with a feedback 




FIGURE 9 is a screen display showing a feedback interface window in feedback 

for the learner iiUerface of r ;-.'!ir-N ^ ■ Sb; 



FIGURE iO is a screen dispiay s.ho^^^ng an aitribute segment list fot ih^ feedback 
mndowQfFigaj^9; 

FIGURE n is a scfeen display showing a coatribuie mode for the feedback 
mndowofFignm^; 

FlGVRh U is a screen display showing a collaborate mode for the feedback 
window of Figure 9; 
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FlCfimES J3a-b sxc scx^n dispisys showmg a feedback icon feedback comext 
being sdected in tise iuterface of Figs^res 8a»Sb: 

HGl 'Rlt i 4 is ji screen dlspijy showiag tfe feedback iaterfsce of Figan: 9 after tijc 
sti|ec{30«$ of ,Hguix;s 13& b lave been made; 

S FIGURE 15 is a sehematic diagram of a prefom-d feedback record stmeture of the 

pm&ntxmtntioiv. 

FIGURE 15a .ts a schematic diagraffi siunvrng r xiunpk- of the conie-sj faid at the 
feedback teccjrd of the presm inveatioa; 

FIGURE 16 i<5 a screeB display showhig & fmjt embodiiBeat of a feedback viewing 
10 mterfsc^- of tfee pi«sent mwatios; 

MOl liE 5? is I. ;scre;eR display showing the viewiag interface of FsgiH^ 16 with a 
different nse; of prefcrsaces; 

FIGURE 18 is a .screen display showing the viewmg Interface of Figure 16 wsth a 
set of preferences; 

IS KGURS 19 & hct&m display showmg a second embodiment of a feedback 

viewmg iatefface; 

HGURE 20 is a flow diagram ifltjstratisg a prefemid method of implementing the 
feedback interface of the piresseat mveniion; 

FIGURE 21 is a flow diagmm illustrating tiie "Process user input and fill record 
2C) accordingly " step of Fsgtsra 20; 

FIGURE 22 is a flow diagram lliusirating a preferred method of smptemesting the 
Ifeedbsck vti^wmg interface of the f ress?!!! tnveatsoa. 

FIGl'RE 23 is *t flow djagrain lUa-^rrating the Scass database ar.ii CK-au.- vi>N«aii^-ei 
records'* step of Mgure 22i 

25 FIGrRE 23a 55; h ^cht:xnhiic dsarrao? of visu^ilker t^::or'\ of prf-;ent (sswtUHX^; 

blGl'RE 2?b is a .schematic diagram (ti an cxasnpk ot orjianK'.anorji.j! na- 
$tj^ctus?e usvcd in sn embodiment of the viewing interface of the pre-ssnt invention; 

FIGURE 24 is a Sow diagram titostmting the "Calcislate combined <;et" step of 
Figt3ss22: 
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FIGURE 2*> is a tlow ajag-au- i kstxannf o "P-ocos.s "k*vv« mpul aics 'ipdatc 
display aca>jxfcnglv' st«p ot Hgure 22; 

FlGURb 26 IS A flov^ djagrani of the 'Proce-^N ckmg«H ' i>tep o*l-i|jafe 25 

HGORE 27 1 A flow diagram of the "Procev, tllrct cfearges and update dispM 
mcammglw" siep of pjg«re 2&: 

ar : Ml burc a.-d ^urtcti«ns ii\s:a to Ucs*.nl>e «irid fjo d>> that leedh^a t om the 
feedback mteriacs; 

FIGLRF 2% a c een iiispkv showmg a sanation ot the e nbodiment of ii?^ 
feedback lateitace as sho%vn m Ftgiim 4: 

r.iVU ^0*1 is i ^ di^f s OS., r embodiment of a feedback mterkce 
&imikr to t^K .i-QC^^Ji. mter-^^ve ^hn\sn m ^igdue 

PIGfTRE 30 s a «5cteet5 dis^iav showng a third embodtwen' of ihe uews-g 

} IGI SKfc 3K^ a screen a sp a> s.hox'tiijg a separate hst of^ suah'-ur attrs^rtcs thst 
ean be iised as a fnnctioa of tiiie mwmg mteiifaGe; 

HGURE 32 1& a scre«i? d ^lay sho^ mg stj example of an additjosal fdto used fm 
&e vsewms mtarfce; 

FTGIRI . Has rims > Mffp of Figure 20 n which tcchnk^I 

aiu Huk»*> arc n^es J is w a imUd x <. \ ucab %ck revoai 

FIGURE 34 i& a flow diag am iUustraung a step of Figure 20 m v>h ch 
orgs smonaJ attnbMes* and perso a1 attftbiHes. are mt eved and inserted i to a teedback 

MBUm M h a 0ow diagrasn ilustrating an aJtemate method of eollectkg 
feedfogek iii a feedback sy^^^ 
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u-c ,\ t'i ^\ te'i <s VK r K { \ kc\h oavn fs- ^ d^sc J \oi„.^ sod 30 J .w^^j^ ^axe i 

top CO ipm&t s>sten^, game machines, pcf^oi\a1 Uigaal asst«ctams. etc 

\^ ^\<mn \ g ' Cvnvmtci system 10 smtabie for impkme nng hs 
10 virnro-exts or 5cvi.h<.^k -v^.o \ ol he .^c^ctit im&nnm mclude$ a ceati^l prwc^smg 
u J „ h cii vct o'-al McvjjT\ bus 14 %vbic;^ c^uplev tne C Vh So rj^^iaoxy :6 s^nj 

>s ^ <^ ^ 'i^v? " h&.^h iL aici hs-d.??cttoral fvjp Ixr o ""0 xv'.x^h connects tne 
<- PI < UiTic.v nejif^h.-j i >in ^o'^ Ilxt! r'enK' rs 'ms > <, JK ^akvi- he fo.i^ ^-v* ooui 
^^<^*a oi \ nvBH\^- uvO^'^ >no ,anh^ ue^s rxixon ^KAjM) ^Lrwy -uappoo 

penpheral devices cau ot- cuuD.c«i to penpnera! bus :o Bs ^.-v^n , x.^sr^^k ^vnuheral 
devices that ms it<iqm% il\ cf^niaueu fo i^e pcnphers^i biA u^clikb 4 v.t^eo can. 2Z % Ach 
costfois a display mo tor 24, a hard disk dr've 26, & floppy disk dnve .-^ CD ROM 
diid/or a etwoik mterface card 29 for I luiig tl^e computer sysiejm 10 Jo 1 1:^^ computci 
sysfea) Addihosally, « keyboard 30 aad a pointer device 32 such as a mouse or teck bail 
are topically coiiaected dis^ctly to the CPU 12 or through m i pat/outpai mtcriace Botli 
the keyboard a d the pomtet dwce at« smrnged to fhnctioa as, aser mpui devices As vs^dl 
be appreciated »y tliosc sklBsd m the art, a wide rarie v of other pe«phera] devices can be 
co?Tr}<. CK'd u > V tbe- r^T^xi:re\^\ bos ot the m:tmn v hos aod the bu&es wi ich co meet the 
2S descnoocs { enphs-aK fo r e f "I ^.n ^0 N^^jtLhcvi and/or additiorsal buses cm be added 
For example, a disspias tablet v>.xh Myhts cas also ha connfCt-?d tr^ peripheral hc\ ?0 to 
provide output ds<-f lays areyoi stiput functions when the user the stylus or .>?he{ 
poiiumg Implemcui 10 ' wnS*," on the tablet, A voice mput dcvtee can als«> be connoettd tD 
eojiipmer system 10 to ailovi? a user to inpot ¥ocai commands, data* etc. 

^ Figure 2 5S a s^chematic diagram of tije compoasnts of a user feedback system 40 of 

the pre$est inves^tion. It is itnportam to note that. aJthoiigh the embodsmeiit of the user 
feedback system described hereto i$ moy^dy addressed to Icarmug e«virotiRiests for 
expiaiiatory purposes, the described invemsoo can easily be used for other aser 
envirottmems on a computer -system, mch as a prtKiuct testing envkoisment or the like, 

S Tims, tbe term "leamitig environment" can also apply us other computer enviionments or 
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ejsv3ro«avfS5 ac% hc h<t juv it< J a lise k>t scjtjjaj* leeai to v'thcf people ti^jus J^vi 
computet &\%mm ot pKop'e %vho h^ne rjo^ided a process., piodu>, wjcc or sssuc 
wfech t&e usei ca^^ x^ixsm feedback about 

Feedback <iyUQm 40 vaanAs a mer feedback mterfaoe 42, a fcedbat^k control blo^ k 
44, aBd a viewmg interface 46 One or more uk&t feedback mierfeccN 4 > a^x^ pirn ided at 
one end of the <vyaem k (he des^cribed emboa-msm, fee feedback irietfdve pro-v=iOcd 
-svjtlan a isrgef coa^utet esviroamesi 48 One compater enviromrjem des<. nbcd heren a 
teammg eaysmmem, which lapiude mch orgmxzmon^ s^vstems as a completer 
edMcatsonal '?\stcm imrlemeated os j.eveTaJ uetmorked computers md used to t^acb comse 
n 1 er 1? ti s 0 nts 'e<jrnm£: ctiviroBment raay take tbc form of a> empiove« m a 

\ u o\ hii ' \ (Oix s K ! a, 5 -Aorker that csrue^s a portable tompuie'- orPD-\ tini 
ujcusuf.^ m 5fixJaHa?.!on.'mainrenanctvfs*pa« or tne hke w^T.iml *hat car be mad ?« 
in;-Trucdona^ mr(tcr;a! for field v-'ork, Iri \hs first {earning envm-snmsrJ, a studcnr or r.<fhc( 
kc^rner can be sityaied a? one- cornpuk-.r «.'rrm«aK f^ucb as compx-ter .sufeiri 10, snd 
'■uavij,'.;ik>" 5.hrougb ;$ ^choo' course or siibjecr, move uoju kssorj k-* icssOiJ oj coacept 
10 concept witUn Uis coarse, lh& courses cm be provided on each tennir,a1 by a teachsr or 
"audK>r" of Ihe coarse by any one of a variety of -w-en-kuowa interface techuigues. 

It at my time while navigating Osfough a course or other "meaning space" (body of 
mfoxBiadon), a iearricr reaches a polm m ocmms; where he or she does not snderstss^d 
ti)e concepts or idem being described, Uje rsser m^w xv&3« s» inform jhe author of die course 
'dhr>ut his or her tj-oubie. Or, a user r^isght ' stutter'- (i.e., shm' down or becotne stopped? 
wrale nn ob ed m a process or servk-e or usifjs; « prod^ict; for example, a consumer ntight 
hav,,; trouble- i^peratiaa axs appliance. The cunsusner oiay ■vva-ii iTiiV-<rrs5 Sh^ supphcr ot rho 
appiiajsce of hi,s or her JroubSe. To acconjpiish th:,>, 010 u?ei s«nJx fctxIbacK to the iaUhor 
or supplier of the product, process, service, or issue. Ilere;r„ - toedb,ick is dciined as 
Comments, suggestions, questions, or <Hhcr iuforroatson scnr by u user or le;irncr to m 
atubof of the learning materia], .reviewer of the learning $y,ste«L provider ot a product, 
proce,ss, i;ervk;e, or sssue, or other person responsible for improvetiwrxt, niaituensnce, 
orgaoizaBOt^, or contem of a product, pnacess, or ser^'ke. For example, by snfonaing the 
mtm about djfftctdt spots m the course with feedback, Ibe student eaa help tbe author to 
becojns' alcxt to which aieas in the coarse need improvement. A student can also provide 
leedbaci: suggestsons m an atnbor or ssviewer abont how a course can be changed to better 
suit that nulividuiii Icnrnsr. A stude?tt thus can help improve the entire- learning 
i;rsviron.mc{n tor hinjoeif and other stndciUs by sendif?g feedhsck, Siudlarly, a constJmer 
cru^ send feedback soformatson to a manufacturer dc,«icribiog his probietns with the 
manufacturer's product to help the matiufacttsrer improve that artd later products. An 
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emplovce coji s;end feeahack mformativni to an employer doi^cnbmg dep-snm^sntai ptobfens 
to licip the empicfvcf miprovc the workmg envifi^uaxnt, A u\er 05 a cotnputoi i3ctv,ork cisai 
send feedback to a system operator abom a network p5?rformaiice Ss^sue that *e opcr^itoi has, 
brvjught to every user's atteauaii. md m 00 

5 In the described embodimcat, wIk a 0 w^i % j^hes scovi secdbsck to a ro'. vi- 

be Gi she accesses the feedback jnterfexc 4:: 'Ihc usti tii^.n mputs tits fct'dback r^sra tools 
provyed by the it5terfsee> When the user has fisisbed with tt^ feedback, or she selects 
a &ps^ikc coMToi to "send' th& feedback aad provide access to the feedback for a revj«wer 
(and/Of othes people ming mamsaining the user's compaier Aymm or p ravidjng the 

10 pffOC«ss, product, service, or jssw)> Feedback misrface 42 automaticaay smds* lbs entered 
feedback to the othei compo»ems of ih© systerr lite »*ccr can theu easji> exjt feedMv k 
mtejf^io: 42 assd, for e'<ismp1e, reHwnj*. whertj he ot ^be lets otf m ^e course of the k^nuaa 
tnx -o-^-i,m I" r a^ctwn^fcedhavk ij*tert<^e ^2. The feedback ititerfav^ v an be a 
Nvp u'. '„na t f-ra . V onpute- $. V tx^-niseiu 'hat is dispkwd is a separate viT,ndovv 

IS drrosf 'x-"^ iu^' soef-n, 'b^^ii-v fxc '^r-^'jv^nvclv th? teei-^'^sck- r*erlacc cm K 
imp<.n n . ^ mh-^i-^ k xMim ? — jrs' ? of m tvn j.HUt.i cfuronmont \o 

inat to eXiL^iplc a le*aaer need onh «ve e«:l ^ tev^ s de toijlrois to seia ieedback x'v.^hoiu 
displaymg a uew wmdow, sexiest, etc. 

By uswg teedback mtcrtace 43 a user can quick ly md ea*5j|y eater fesdhack abo^^t a 
20 spectfsc topic Without takiag a lot of sssxtra ttiise to do so Thcreatter, a u&cr cm \mi &s 
easii> lesnme tlse k^mg process ("flow ') or other activity m the cotnputer ens ironment 
after mputtiug the feedback The user is thus* eucotjraged to enter mor^ feedback, aiid mote 
con&tructjve ieedbacK, to help the re^ jewm or providers on the other end of the &>stcm it 
jmproYe the ieammg subiecE or the provided prcduct, process, or service. 

2S Tne feedback mfonnation input by the user m feedback interface 42 pr^teiabJv 

%cni to & feedback &iotage Mock 44 In the dc&cnhed embodiment, bioeic 44 ncUdc& a 
databave, accessible through a netwotk, which stores tiie ieedbac'^ ^U-».nui <a\ xn bv the 
user of feedback iutetiacc 42 Aitemattveiv feedback data can be stt<rei' to i.xicci 
ioca^ to a feedback lecspiem, such as on & hmd disk diive of computej j^ystcrrj 10, aid, tor 

30 exampk, matk'd tlmsughotit a sietwork when so requested Block 44 pi\>s ide^. the feedback 
rtoi-j-it^o ) th^ dai tbisc to '>peLJi<^ a ilh \rci n^xautj n | at^ ^ --o\ vj; ih \ 
r ivelraA miirn, u*" ^'^h<.^ t.x^i.ifK oji^pt^'v >-\-^'in c^t, i t. ^evH>s ^ 
xJ^rn so. -u* -.nl n us^.' d 1 s ^^ j k ^ ><v,h. snur . 4 ^ 

35 i n w < . c J V K i 5 ^ ^ i Uvi, h Khh i 

f-.a- Ss^ 1 sen is <„UcI ! \ ^ - iM ^ V i UL. S^s i^^ 
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U\ out storage biock 44 may U indoded wi'iun k^mnf o» oihci i.om'jms" am ^rc nmv-nr t«s 
or authoring Ofi\iroamc«t 5U, or blovk 44 ma\ be p^t ot a cejura prfxcNSjne ^''^stotK as 
^hov>n m Fjgujv; 2 M«thf>d<? atso <>pparaU>v for sto'-juf duabasc ituoimatiot* ore ^I'll 
kno-wn to those sfeilfcd m the 

S BlovK 4 1«!0 caj uii. ■-jm) it. s 1 ^ i t t u s n < 'h u 

tntetiace 42 '^nen iet,dKtA joUrtisc t2 i<i ^^.<^^\\^,iJ, ^\ ^U" oncx ^K'sis mh^ i e 
teatures, appearasee m6 opcsatsoa of teedback jorerf^cc cm be pt<y% tdeJ trom a ^ I * 
eavtronnient 48 .md/or feedfo^ick sn^erfas e 4i For example, ^ reviewer opc-a^u g \ j'^'v*. >^ 
mtsrface 4& may be able to coatroi Oi set tlie appearance m6 opejatKii ol menu uems 

JO icom, xaessage'v. pjoaipted f{5edba<.k ejitrtes (desciilsed Mow) and other ieattws a\ ailabic 
to ihe aser m ieedbaek mteiface 42 to provide aa jmerf&t e custoaiiEed for the «^er s md 
revjcvt er'i apfhcauors'. The data whafe desenbe^ and xaspfcmems tm T%te'»e< selected 
J m s m \ '^t'Nf^n <;fong«^ bJvH k And pnnidv J k> feedback i>3tv,ji*Kv 42 v^hvn thv? 
tcv h^'-Kirf'^ -^2 acc &wub\ i^eynei or «Uera?fnt3v \\heqe\er tht-^e ts'tLJc; ife 

15 ch y^ged g cnange«« toe fcamrefe csj^ he 5>a\cd kst^dh lo iht fe^dHa*. k mt'^.-t'ice^ 

ViewtHg iiiterfa«.e 46 rss-eives feedback tssfomjation irt^m vioragc block 44 L <he 
described embodiment, yi«wmg jftcerface 46 cas bis a conipo»eat of an authoritif 
esvxfoanieat 5G» whicb caa mclade otbsr asthoOTg tools tor creating md editmg coarises 
Md other mfomsaJj^B psesested Alternatively, viewmg mterface 4& eao be iadepeaderil of 

m dn suthor»ng cnvtronroent and eas be u&ed onl> for artaiiy^jtig, aad responding u 

feedback d«a Fx \ tn 5: 1-- a« aa bor wi us the x'ie%vt«g interface a& one more tool ta 
h v'^eat^oj* oXiLit^i t imm» coutst \ /\ sun(,natendent or other adnumstraiof xn aa 
organisation 5t5tgh no x m s njo' f aov t,o«rst.<; bi o-' oht s 5 \>' miiOMSs^ fci. iK k of 
mioimitjonor a "iervkv \\\ iv.n ' ihe o«gi .»^atnn > ff c( 1 i w v >t ne 

2§ Oigant/aCios 7he adpw <?t{atot ^'ould tlms only regain? the vicv^ mg nJVuave 4!: 

A reviewer rvcctvest the feedback ssformabon at his or her oma cotnputer system 
prt.ieiah?j tijjough a tietftork sy^m ^.oanectsng tne c*>tnpt3teis m the eniire stem Such 
a aetxvoik system be implemented tm *.\amff3e, tismg a network interface card 29 
uonmci -c* to a i omputcf w^tem JO ai. sho^s m Fiaure I Othc^ methods ato be used 

3D Ui ptovide the feed ^ack data from users to a reviewer & computer, for e\ampie feeiback 
data n -ti - n ! h-iONfmcd u» a £l»?tW\ disk o- o -nc-i 30 to 1 k ^.i'.v s 
comp a ' I M'^'-i.i i,^^ J t iht ic vrcTjp'sti u^,tcn i\ u t i t ( )i 

eedb. k X V <• " i-jc n ^ Ls t k^,^H> su i oni n '^t k 44 

■v'. b tali J05 ncnsKU-jt -^s t ^ r Ik w^wn„ vrt 

35 r 1 Jis^ t\^t (, * i i , N ; Ut ^ ^ 5 ni 'i \ bi I 

5 V f.^! s jikr i t \ 5 i b 1 s r >. ^ s \ 10 

St. < (. *\ se 1 1 o v,t fc' ^uutxO <^ ^tfid scttmg-v dJ^piaved i \ t K \ c\vjh^ t. 
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alter the pattem^ md vtcvn tiie feedback jofdaatioji accordsttg to specific Rn'jew« 
prefcreaces, enteria and needjs, "fhc rcvxev^er can also tospoj^d to Mbai-k i{em$ bv 
sendmg a direct s^sponse to or inipiemenung action for iha uj^er who emca'd feedback 05 
to another related person. Is? additioa. the reviewer can ptclerabl> cu^tomi^e ihe 
S af pcaranco . nd in xtioti d the viewiag interface 46 aad the feedback mterfai^e 42 anwdstig 
to h or h«r r.^^ Js Vtewiug 'merface 46 is described m more detail witii reference to 
Mgums .16-19 a«d 30. 

Feedback systetit 40 caa eatail several feedback mte-rtaces 42 at one the 
system and s^everai ^'iewmg mierfaces 46 at the other end of the system, Faoh ol hundjcds 
XO Of thousands of «sm can send feedback abom anv subject irj the leattutig or ct>mpuier 
etsvmsnment or iinytlstiig in their interest. All of this feedback tnfotmatjos is organised by 
the feedback system and received by reviewers at the other end of the ^ysttm Thus, 
virtaaBy tto titne t& needed to accurately aftd fle>db1y present feedback to reviewerssi who cm 
help the users and improve the eanjpotc'- cnvtronmem or other i:»rv>dtKt, process, or 
IS service. 

Feedback system 40 cr.-i j-te u^s^d, lor e%anpie. m sevejai difkrent leara:ng 
e»vironjtieats. As de&crihed above, a student CvU} the feedback system while iearamg 
from a ^hool course or subject on a computer system in an ed«catiortai envsronracnt 4 
teacber or course aatlior reeeives the feedback aad cau eorresposdmgiy change and 

m itiiprove the course to suit the students (asore options to the course can be addedy further 
des>cnption can be added, etc ). Smiii^iy, feedback -system 40 is well suited to bssine^^s 
etiv'roamcnts m mdustrv- Workers* or employees of vanous levels can use feedback 
mter dc. 41 to mput fccviback about lOb prjicedures. compaB> piocedure^,, ou-tiie-joh 
orobcn* cti. they are ic*sT.mg proceoores oit a computer n\ stem Masaget&, 

2S Siq&;\iso.'5 plarmxr^ srgimi 'f^rs -ii^d oth<.j aJrrs'ijH^radve people can vje^v the workers* 
ieeJbj.. on r >c vicv i, ? rtcna 0 ^o ^kI Kvo-).- m >n-med of coiupany inelTsciencic^ and 
prohierSi^ far^^iiund When njanagetneut emi tcce:ve feedback directly from workers, a 
coaii^Ttj 's mefficionctes cau be effectively reduced. 

Otuer computer envtrouments also have a need for the user feedback system of the 
:« present mvestiou, For example, a beta te.stmg envtroiisaent prt?vides a product or service to 
.sever;i] tesdns? ptjrsonnei or customers who provide feedback to tiie developers about the 
prodiKn. or m-^ncc. A feedback sy.%teni, stscij as that of the pjssent invetJiion, that greatiy 
Ci^baace? and ainpliBcs the ability lo collect, viev.? aud analyse feedback would be 
ii-ivakifible in discos-ering- probkniS in a tested prMuci, p--oces<;, or ^ct vlce. i-eedback 
35 h"tr.eruicc 42 could be used, foj exai«ple, by ssser- lejtiiig & sofiv are produci; ihc feedbisck 
iinerfac^- can be smplersii^nied as a sco,iKik .ipi;\s.,at\-ii r^-;^!.';^? --r -x^^ ;\ tc.tJu=c or tool 
inciyded withio a software product, .A.ny environment in which there exists a bi-direcijona; 
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How of mit njjai'f)" between a ptovfUei s i pro^*u^ proc^-^s, o jco a usa of raa* 
pnduct, proce f^r \}ce w.-^jild fnd ^ need tot ^ ^otdbA<,k ^\vtem, such as t^ic 

r service. 




That &aine person cowJd -it ^> lutci i% le, hecon-';^ <i icx b> 
5 46 to filters 

Such m embodiii e it h.3ve me as & a cmorj' extender" to allo% a person lo 

r 6f M^lf for sdf- 



.nput d fOvCHac' < c t 0 attabuie- anJ ran'urm^ i fv1 " < ? h p <. > < Uu 
ft?d»\ok ho x\ ^etJbdck nierfoce 12 M the descnbeu ex^ ho ^ i t.^ from a 

ust 510 H gen«;r&^!v contextual scd by tecJjmcai atmhmo^ ^ o l.^i.^uo-iaI aftnhmes 
5 $4 persosal Mtnbuto 5J6, general aitobutes 518, a d Sit«atJO» specific sunbutes 520 

coasjdered \yht&m di&cemable' attrbutes xn that thssse attrsbttes csa prefsrafolj be 
amomatioaH^ 6i^csm&d by the con pimx system which the JS us ng to ente feedback 
General .ttribucs, a-d sttuatioii pecifK attnba ccm be con^idea-d " ystea 
ayv-nv-stcd" attt.btJtts it. that a use ts pFcfcrabl> teqmj^d to enter or coaf tm the e 
rtheuser%g 

dbyt] 




dateatidtoatwMciv 
i b> the ufeer \lteinat \ay as described belo\-v w th 
jctercate o Figure 15, the date and ttmo of the li^er h st acre^>sing the leedback mieff4ce 
as n the dati.^ .»fid tune when the aset ex ts the tterface can both be recorded in the teedback 
t«cord. 

Technical attnoutes 5 1 2 tho&e atMbUve^ dev ohuK the ^.OHipu*^ em ! . o< nt 
wh oh is implcitie. ««g the toeabav.k mterfaee 12 wkch cai> preferah y he discerned Dy the 
feedback &\>.te n ui4 aUvOmatsciJh snNCtted j Uv* a feedhacK record \ hsn a u»er si itsati. s the 
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feedback interface. The technical attributes, somewhat hierarchically showa m Figure 28, 
can be stored in a feedback record and iachide tho mmotk type and current Bod« of the 
computer enviroamsist implemsntrng the feedback interface, the hardwas« plattoms the a<jer 
is nsing 0,e„ manufactufer, hardware n'pe, peripherals, etc.), the operating syste?B used 
S. by the usci, the application program used just prjcr to using feedb&ck interface 42. the 
database th?.- UNsr \v;-$s prcvjou^iy «!iiug, the document the user %vas previousiy 
mampulaiiiig, the object ir ihc sUH.ar)!<-ni u^c- hac ..dt^itid. and attributes of ihc object 
that the user bad sekctsa. st!C\ u-. -s/o ooo*-. nkjpnu<, ou^ Olniouriix, nianv of ths'ss.' 
technical attiibutes ro;:sy sso; ha appikabJc or discemabie for a given sitoation; for example, 
10 if fhe isser w;?-; J50t issint^ nr cormected with a database, no database informatiois woaid be 
mcluded lit the feedback recorti 

Some or ail of these technical attnbtstes, in some situations, tnay aiso be the comext 
of the user wbicis the user's feedback refers to and describes (i.e., the context of the user's 
feedback). In other situations, teschmcal attributes 512 can simply provide data about the 

IS; user md the system he or she was using, whiie the user's feedback has different context. 
For example, teehs^ical attdbtJtes 512 can describe the context of the user'^j feedback when 
the tiser eaters feedback about a sentence ("objecf") in a woid proces.^ing program 
('■application") that the iwer was using pri'\'K>u,s to euterirxs? fhc tcedb;ick interface. Jf ti^at 
word processing program was being usco ^viih ihc sasTit< i^pijnj'.inj.' .sysrciTi, hard%vgre 

20 piati'ofni. and netvvork us the feedback srJ.erl.^cc thcsi ;dl r>f the i5;chTjicai <'!SSr;hssrcs corroctiy 
de^scrlbe tJie context of the user's feedback. Hosvever. if the tsser etueted fccdf>acl on a 
topic such as employee salaries or a word processing progtan^ on a different hardware 
plaSfomt, the technical attribute* would not (or wouid only partiaity) dascnbe the eosrext of 
the feedback (feedback cotttext Is described In greater detail witb reference to Figure 4). 

25 The technical attribates 512 ate preferably always saved m the fee^sack rtscord in a specific 
Held to provide infomialion about &e teebmcai context of the Uiser to reviewers at the other 
end of feedi:^ek sy.^tetn 40 (see ¥ipm 15), 

vjrt ar r< t .<n< ^ l ihuK -if s <. \iis h -suts* k n. ^ K 
de>5i sbs .J I'-it. dsi^rs o ^i.^ a.n tjrga'ii/atjooai < uxi -i-, u vtl im ^ n tKV> a \'u ou 

30 jsiicb a^ a ^usme^sv^ig-iniyatioti school system, club c„ ih<<-a!^ ^ KVv^5j...sl 
,i(tnbutCN ^.2 CstupHtctaDh be autt>niatwaliy mserto*. a<ti.> k^uuu^ jru ■!^ i < 
ieedback <;vsstem when a user acce«>se& feedback nteriace A2 ^ -o d \cc c 

.tttnbutcs) 1 tie orgaaigatjonal attributes can mclnde the user's^ co*. i^a n toi d et^ ! 
depv^ tmcnt. pro|eCv, pr duel aidvr ^rvice fox wh^ch the ui.ei is* ressponsible, job {i e 

3S occupation tnie), specttk ti\k of the mo L-^c standa d method or procedo e for 
tmpkmentjng the n^cr tr*4. and the n. sources* the tiser h'^s^ access to for sniplementtng the 
method >r proct dure ISo. ail thc<,c o'-f &n52AttJ->':ttl att hute^ n ay be appitcabJe n a 
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pajlicoiM iimo\ T-orexanple ausei esripknee oi «c«.Wfi5«v \^ojkiTithe Qualm 
A surface dcpafi siem o i a project tor the i&fest product i«,i«ss asd u«\ hasi spCvtiK 
ta k, method, oi r&s» msei> rfS&igned ta bm tiio e orgf^mj-a ton< 1 a^jbaies v^ould thus iHy 
bs recorded trj the feedback, record. 

O gamsattonai attob^tes are diSiL.«mab1e attnbw^^ and ihuv ^.a^t <.wc«tied 
ass default attributes ior a particular feedback laterface For exanipte, a orker & ccn pam 
dep«ment, ext , ca be i )ptn befbisfeaiid mto a ^pec^fsc compute tettamil 03 **s-*o<.iaie£t 
With a particular feedback iMerface %vifui.h tt?at wor' e would ^sormailv use, or this 
inkrmatjon ^.tuld bi sstored ort « database connected to the feedba»'K tc r^cc \ia a 
mtwof k Tb£ 1 ifouTsatson couM tben be ^sntomatscaily jstsieved »¥ the feedb< nH'rfsv e 
Smularlj to the tei h la! attnbutcs 512. son^e cc all of orgajjustional aUribmes mav &pet t> 
d 0 coatext t f the user *i feedback n >» me cas« n winch the user'$ feedback j<i< co iceined 
w«h users p ojecU job etc * s weH as descnbe the t er la othvf cases, the orgaiii/at oral 
atmbuies mav riot descnbe the feedback co e t at ali md only devcnbe the use 

Pctsona! d inbules* 51*3 are aUnbutcx 'S'tech dvSCdbe ps ona{ ^< ta aK 0* the use ol 
teedba^ k tn\ rface 4? These atttibutes ase al&o preierably 'ivstem disceuubse, al hoa^h 5- 
othe ea bodjment thev {.4x1 be emered by a usu Pers»on.al attributes 516 mdude the 
tise % same address (e g , postal addre&s, work address etc ), "^ex, age and othe 
deriiogttjphjc data. Sucb demographic data cm mclude the user's honse city or the city he 
or she works n the ut\ «. r locatjo ) whe e teeabaj-k is e terod, the a&e ' &.tate, region, 
socu. sect ntx nufrbe edttcatio 1, etc Other pt ^om\ «n sbutes, can a! o be addoJ to a 
ieeilvck tetvid miv* i<. a y^^^A eve vo o^ rriL(<K ^ *i<.f^i t«ming bi&tory, test scores 
hv £;h v^es^fh ix^hhts ^n<. n K r rfct^sts Thest, ^itnNH. m onvo Cv'H iescnhf a 
teeJKck 'ev i n k v <^K.\^nhii th& iihin^ > n \ > s ^ l m o a mot >. i 

tecd^avk -tvOiu di^mi ^ w-^t v^niv^h a -cv cw^t mxghi u-^e a«> cr et<a to * Itei ..-.a rixiscnt 
feedback ttems, 

Oeueral attributes 51S ate sys em ^gmested attributes, i e , thev arc dcf aed, 
selected and^o cor£rmed by the user ea-^h t mc the user eater feedback mormatiou n 
u t mttil KL - ^ Th* ^vnersJ ittnbtit«s can mclade *^ha " {sjtuatiou^ attributes, 
^'.hKh ^ ! n% str ")tt><n of ttx ^\&r when en crag feedback, when" ^response* 
f ibuk \ t'^ If'.iuK 1 t i -Ti.'v otms. ft «,dDav,k and ^^r-Sf^HNC cUk ved'^ad ' 
^ 'V ' <■ \i t insti} AhK^ cesc ibc v.tst.h u f-r im 

tui \ isottcc b wnt 'i^^-^^ xio n SB ; cn 4 n^J l i.n ; <ni i ^ 
<. m iso m ut: miK^t M ^ t % ^.s i.^ ^ 'U po ro \ ni t 

s<.r<.r5 ^nn k"'i>^J^ ndxUi ^ uu5 uvnut 5tr« btu v? « t ^ j on-. 
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^^amnam kob cart mdi(. irc th-it fhe usti c ite<i«^ t*5e f«^<. i i^acii. hi*; i poiai ^ jtw 
c?'st«mcr n comimut a depoi *tifc-at x^nith pi'rch<5s<,s tjoa^ asothei dtfoTTrstoi e < 1 
^ I s 6,r it^oas r t»3(. ic<nt pojnts ut M^^t ba^ea os^ 4ivtmt\ output o m u-^i.' 

in\nt otn mt u'-s; the ic->Ovi t-es used h\ ^he «%ei Gv.st,ral attributes wan also 

}0 Sitamoti specsSu attnbutes 520 aie wv-tem aagmested attnbu?e& iuxtiMQns ht<^h 

provide a ijser -s-tthadditsonai opttoa«s xvher mm\ti$ feedback, and ^ftfcch m&\ ht. spec^tt*, 
to partscukr u.ser\ «eeds The tmit-^K ' ftjncUou ot feedback ituerface 42 aUo\^N a uses t* 
•-^■vk %^ ft hst ot piOiTipted teedbsck items -^feiUi .ju\ destnbe the user *5 tccdback tnu ate 
tieNcnheu 'V'.^ jt-krence to the prompted feedback it».m»> 121 and 12^ oi Firare 6 T^k 

15 r" -^Mr n n i! ot W^il iu*^cr*avt 42 Jkn\<v ^ is " $0 <^<»5 1 -^lU s sJ iton I'^Ki. 
t J) s ( i-^-) t^t, <T\5 s\ bsi ln(,i<^$. ?ksd'>"sn \i\ \ s|\^i. t n i,rtf^ 
k"'^cr sn ibuus Is ot hi<i kr ^^ ^ \ In n kunp tni s-^nii ^jxvU*)* a 
ievdbi. X T 1 ujNf iHs ti. \ I V u s «\ei (. rcsp s'^t- to thw c^^rrr on 

te^. it >.\ '■s.riN fhc >^s. K t s i I n k int Ut. ox% s a j<;s.i to uc i 

JO ot h^i o r tec J w i ht. \ m u t r r o t <; 1 m u*,? s reviewed it.eaba<.k 
iteij on J i^o'^e^ifcnd o r ni^r ov^n kcao4<.k Ti v use«- gen*.rate^ tlte feedback 
through the described teatures ot feedback mterface 4*. tncludtng the general attxibmes 
spectre message content, md other metius, buttons, etc, as descnbed below with 
refeTeni,e to Hpjre& 4 " and 14 Fm^illy the send' funaotiaiiowsauicf *0pJ0VidchiS 

25 m her fc -^dback to a ^v\ov> er pre^rabH a storage block 44 of tveabatk record^ on^. >■ 

I5i U n < ! I i ! s r n „ o u| I s c 5 n t 5^ 

embtxhm ^t «. 5 n s t u» -s n<. r o n ! o h nt i\ 

33 01 a >.ompany v^here a worker can look up tc&tmg pjotedure^ companv pohcses 
persoR?3ci etc hrmf'^n through an la^tmctioaal manual Interface 52 cati aho easslv be 
«\cd Joj a tesUnK euvm-jnment, is-bemii for example i}*;efs to cntei ttedbavk about a 
ts'vttd or ast d product C ategorv tselds 5(> mdicate the subie«.t cate^jones x the context 
that w seiCi^tcd b% a o er to aci^c <i a sptctfje subject in leanung mtertacc 52 Pmerabh , 

3S ti^Ids ^6 becom.. moK spetiftc m iuope gomg trotu left to nght atid top to bottoas imoTs 
-^d are vvMble I i^nrev -jb- -^d) Ds vp|?> art.a '^hxs used fo£ di&pla> mg mtonnattou 
\bot5t tki. Hibic-{ \\.hit.i tl V use-^ I as a>,cessed Shd,,r ba^ '^'^ ti be UNCd to ^aoU tiuouah a 
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doctsKJCR oi other torro of mtoniwtjor -Vrr^fw cons? 60 dfv used to A'>ola\ vSiiditionai 
mfoan Mxoti sto^d uj r$xa*eil m%m s^nan m»-*iisK s for e\*amp.e i Nj^ic^ f>c dOvumttjt m a 
V m an M^v-^ i And t-^t nr-hx or mxvious document tn a ImtMh ^tzur^^M <.o«r\o 
lu - n^^ i. vVNvvi j . « nov\N6*^ Hedback jcon 62 used to ^ecesN the teedbs^ k 
m 4 i s.'sdmeJm urJcnktaj! %3tha'tcjK«v.e uj ri|^«'^ !•) Banons €3 ate used for 
K r- ' io mi. a o ia^ ianciK>ns t.h , s '^aMj;;^! on fea i3g$> ^ course accc^ss tu user 
I'jsp 4> or.jie'-ctju'^, a-^a rtCCt&s (o a aoiepac* v r vmjl > ieatus-c 

Figufv 3a j»hows» armw 54 seiectjr^'^ -i va^cgon torn *i kst m itrs* field f 4 \ 
54 iudacaies wh«srs a posnting (Sevtce, such as a moti&e, styfuv etc . cusmith pomttna 
The hsc ot subject** m ficid 64 i$ a choice oi uitegone^ fc^ Use kmin to to dense the 
sabjeet to be dnpkved Other fields fslsown boioxsv) 'i^sll show wh-catcgonc^ of selected 
categones sn ptevsousjy-defmed fields. 

t^om rsi in d 64 aiid u va ket. ou ^s,< o'" M ^ ^ --11 )nk 

^C!. ond nciii iumlar to tirs iiekl n ->ho^\o Fi^^ s j ; i , 

V*- nK.n a c&iegnr^- hav been NOlccted tuM ftttU 64 < ui a» v sekvi i.r . hia--^ If' 
to dispUy a ii^st of categonev as vho-wts ^sj Figure 3b The dispisyed topjo ate mh 
catogones of the ^eie^ted ^stegoiy chosen m fseld 64 1'Tschaical' ) la FigGi& l&^amnz 
mteff<d<.e 52 js, vhowrt tn which the categon "Testitjg has been choser m second categorv 
field 6:3, and the third category field 67 has been selected to piovjde ihe dsspk^vd bst ?n 

Fikuri, i vfiov^s^i 'e<nifr mtctfa^i, 3 v bki 1 5 nes ^ s dv-U u i t, sub U 
W3shcstoiean\about le hisJearaangcontm, amsjs s-iiHjh ( "^1 r sht t 
can ha%e dtfietem amount of categones as^sociatcJ v> idi tiitu A. t v ! )s s in' ^ sub^t. 
cat. be dsfjjied further whcs, attcr a field taps>. is -s*. iectcd, tii^ . >.> v ^Ud i'- i splayed as a 
t^lml held Bach category m a fieM 1% & ^sub-catcgofy of the c>.ie r\ isted ahms it 
DepcnJmg oti the le-aruipg mterface used and the ^abiet-t chosen diMerent &ubiec{s %sU 
t^f Kal y have diffexeiit degrees of detad For example, some mh\ecih nuighi osiJ? have 
tlisee leveK of categories, whf e other; may have five level** Display area 58 displays 
texkiai 3«fo«'Ji3at30fi on the chosen category Thus, iti i^igtsre "^d text tot closi^out te<*t 
I tsxu v-es mJc^K testjfig shviwr in c i.'4x.i' !^««x>d?raenr su H m " ' can 
^ On i. -^djs^^ i> iitte sent {-vtjtivnn or tile le^-iviithn sm t^fK Into Min Mun h 1 >rT^H 
beside? te'<t cd.u ptcferabiy f>e displayed m display asea 58, Fo£ exainpls;, pictures or 
anixrjatior. caj> he d!^;pKn ed !n cotsjunclio ) witli souud from a connected speaker to pfe&em 
ittfoOTattos in a ditk^ci^i st^ie. 
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Figure 5d aJs.-^ s,1jo\%^ Jeedkick « btghhghted. mdicatmg hat (he k\«i5cr I 
selected the icon lo access Jhe feedback sntesface f ^ihown m Hgmx-s 4-Tf 

sttfibutc koss 7t^ prf "flpttd feedback mid juj^ut ajo^t hiK ant' c^ok b<)\ j?l Ti.e 
feedhack iritcrfece is prefer ably displayed men the ieamcr Isas selecfed feedback icon 62 as 
^howii in Figure M. Pislds 5? speciify the subject or context of tlie feedback, i.e., fieldj. 
57 n?fbr to the piquet, process, service, or other coate t wMcis the us»er wtshc; to e ner 

10 feedback about. Tb s context caa aiso be lefertied lo the u&cr's 'location' m a product, 
process or seivice (which cm include, for e-ssample a physical k>cafeon i jspace o wttlim 
an organimion, network, etc a d correspond* to the "where" general attribute as f^hown 
in Fjgurt, 2H. For examflc ib- u^-ef's- kx-aLn- %5{S-m the k-^tssmtjg course is specified b> 
f elas 5*? Fields 5? t>-sr \ckra;^iv J!<.piave>.^ s - K\ tocdb<sck mtcnace having the saw 

IS ca epf^nox or> . ^fso.i an 1 m the sarte dispiovvu v.rea as f eklN -^6 ir the cunjnsi mierfate 52 
1 has a k^itw usmi fearrset interface -^1' docs ^oi .vni ts^ s.-ssi-iiv ^-^xh j.ub-cci Oi context 
he or she 5s, sei duig feedback abom, s,u5C^ the ^eammg interface dlrtau) specifies tha* 
subject or costext 

in other ctiibodi rsents, fields 57 can be specified b the co ipater envirsosiment ii.scd 
m by tive user when feedback va^ selected. ITse feedback mterface 42 cdn pmvide user 
techmcai attrjfeiites S12, organsKatioaa] attdbstes 514, orpersonai attrlbtites 516, kaown 
from fee user's computer system as dcscnbed with refemnce to Figure 28, a default 
CiiHtext m h^kU 51 For example, if the user was uDerating a word t>rocv^fe'^ot when he 
Nclecied access tcedback inteUace 42, ftsjld}* 57 cm be autonuucvdl) set »Li;:-s *he 
25 \s < rc riKvt'^Nor, r.e d> )c. meiii. the page, etc, where the user was kicated when he chose to 
t."; rr oe^'-^a^ V \h\ be coaveaient if the user'.s feedback efers to such m 
autoiratjcalh ^.jK^cdled cootext 

HeJds 57 caa also prefcrsbiy be laodiSed by the ieastjssr or user ia the sanie way as 
fields 56 m: modified in iesmiag imerface 52. A usyer can tb»s chatige categories to a new 

30 subjcvi or eorjtext artd emer feedbaek on that new subject or context. In coaiputer or other 
ci^\ .'0''5nii\ns whcjii* jJjo usej s vos te\£ cauffi>r ^&s^\\ sxij aror-.t: tai v Oc u^^t^nxr 
stv, uzc m {i{.\ih 5/, trie user csoid seicct (be conis.\t Is^.'^K " ^ tn^^. tccdt)a - 
ir*\t.xx I" accossca o : avc a Jes. red set o. p-e .-.r<.a o di ca'eg.n c K 
atUi -nat v/is --in^Jit-i 'J.^^m tna >.'^air>\^<i\ .Totro'- -^'pON ^trH^j.cs «s sh.^'c,''; m " «<n.r." 

3.5 oj *tO-r a fHM.eJ 's . a ^ iv^ I oa pr^tencO xsisak-uU tic 

sOvt-ifvcalvj^.-^utf. s^uv^ J . an'v. .^!) ^, - a .uncitmof 

siODs and oflvj Ic I'ua pun ir.eo sc, tct'dct,isk iutuUvC 4J. .;s (>xt> <iineJ Vl-.^ 
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Feedbsjck mtertace 42 aJso mcludes a row of icons 76. Each of lhes« icons csni be 
selected by the learner to pfovMe a ]\si of S£*Jectioas th&t h\tih&t define the feedback item. 
In - he prctencd en^bodimcnt, {con& 76 are set to default or ptefensd sekctions wMcli tiic 
learner spccincd pteviously, for example, the last time he or she accessed the feedback 
5 mrerfacc, or in a special piefeR^nces wisdow. The specific icons displayed can vao' 
depeodijig oa the costext specified in fields 57, as descdbed below. 

Icons 76 of the described embodiment laclude fe^back ieo» 82, mpm mode ieoa 
84, sitiisfios attribute icoa 86, response attribute icon 88, $hBsm$ attribute icon 90, and 
sead icoa 92, Feedback icon Z2 allows the learner to select from difjferent feedback aiodes, 

10 Examples of feedback modes are described m detaM below with mfereisce io Figures 9, 1 1 
and 12 which show a second embodiment of a feedback mtesface. Inpm mode koa 84 
allows the user to specify the mods of Inpnt he or she pMers to use. For example, when 
icon U is selected, a drop-dowa menu is displayed which provides ico« choices for 
keyboard input, stylus or pen input, voice (microphone) iapBt, telephone/voice mail mpm, 

IS etc. 

Situation (or ' what") athibnte icoa 86 shows a selected attribute thiit is assigaed ro 
the cuntsst feedback item. If kos 86 is selected by the learner, a list of several situation 
attributes ase displayed vertically. The learner can select one of the attribate items m the 
hst, and the selecteti jtem is the displayed as tcos 86. Situatios attritee icon is described in 

m Tiore detail %v«h letetc ce to Figitte 5a Resp^ (or "whefl ) attnbute icm SB shows a 
sekacd rc<?f>->n'5C fttobate thd is dh%is.nM to the ctjireM feedback nem ico 88 n 
ci?vt jg'a bt\o\^ ith reicren^e to F s<f{<a' 5b Shamg lor ' % ho ') attr butc icoa show»> a 
<>eji-at i -mj. J^rsbue b f n . n sgncd to the axrr-n? t-'-dhi ^ ittn m J ^ d.;^^.^bv^i 
uu \ i\ to vSK toF.^utV O. vxurs^ rf,>K an sbu v Kskv i h ^ ^ H-j'^'-s r c a 

2S jnWvI m> k . sb uci tC0ib„ck ^-s tx.nM t- P0\ h \^ h^^-xn 
h i '-i, li ^ \a 3^5k u a .t^r oa^s nb"^ fe,. ka^,N S i .o-^^.Ji^ Ik . ^ttt 
kju<.ui li^ul <<k v.mothe (..Jt<b»is v^htiv u sur^a iui n I \^ik,s lUhsr, 
anartMc s:.'- b) "V pfietered ca^bodimem o u tbr < ts^nn-^^k^ i. i"- \<. n 
< • sma jcalA txiis^J iro.a ieedback mtedace 12 a^o ret us to le^-~^m|f mtaU^i, ^2 

m otbvr cou-«m{er mtertace o envjw €\t) Iti as alteruatse en bodiment. the mer can ester 
anofhv" (eedback to a H ahuirg thtf con«exr fieldv and/or jccns 76 and teedback 
mtc * Hvt 42 < <ii e ^at ^ ■^ek*. t ^ iosc box S U w menu s <. r (n "■ ^ 

•^^ ni -s il ' 5U5 5 kf n nj . . lo J „ e M n e ^ 

35 \0 » i t i!k \ . <•! o tnter < vpaifjc tccdbavk n^i-ssa^e a-^^sut ih <> ki.t!,J 
"■i' ^i. '■■^i I njs ' LN'^i^e ca Iv xitv^ed dxid rejsponded to bv te\ ev^cr on the other 
k K ft v'-'^sum 
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? igure shov ^ feedback nti,ii4.<^^ 42 -sji tan oj ait ibu^e icoo <,elei. tsd A 
U<* of pcf s bio sjtuauon atmbxjte ' ^egnieMK" is di'^j^ksed \cn,cA.v Ihtsm, an a?.}.b« e 
N i - o-c oi he >)o\«iotlc (itmhufe ^Uncc So that pinicul^ aUnbute Axtv bme 

5 A inbuf" Nv ^^\K i 94 u.t (,<ilg*> thai SL,. u^^ei fccdbacst js s sug's-es sor <>r Hc-^ i >o K 

1 1K'i> toi^cer-v a conplrju ih t hv ^ . h <■ vnn-'annc h sps;c5rk<. ^ ^mcx .mt 
J nh'sk s n ui JfJO mdjcAtes i»c ^fH a -.KnujIvs n^l'hciis<.r i'ic^p^itu\<\ a. . ■><. 

f K s mi: > U<.s^ Mttu ion at>rihiitt si^n^enw lo Uv.&«.jjbei his or h'-- tv^il < Hit; u\t.' 
r also dcudc not to select * m or tivse tu^itton attr M s«s -jegn cm^ it fot exa npk hs 
u e feedback dmh not easjlj { t mio one of tlw&c Mfejaton uaie^iN Ot j-oufN^ n 
alternate «fabodsmeats add uom. cyoes of s. fUdUoif* cm bs added to tiie &jtuai on at!nb«a 
15 hs for exampk a tommffTit toEi <.m be addgd foj user cojrmetjts about titc spCv fisu 
eoatext, 

Tbv. '^f^^i c ijtfrtt^ ^ '^s r d 100 \*-v,Mhh \ us ^.Hiim ic >U\ x-v I 

tht Npet-ii.ti v«n>.ext -^"-o \ i ir f H f ». u rs* v. n j l jn h \ cad s 
vertK*. r'^tu bt^ oMt*'^ u OS $|,|.K>?;n i*- on u ud i\u fi i v\ rt pi" 
20 «,OUt.\t > v.>os<.ou is ( iu ( t 5 ^ns sh\%£ n ^shr n -sk t; j ed 

Ho^c^e * a v.omv4i of Cmp>o\e.i Aunuics is spec ltd, an aat ti^nJ seancftt 
1 idicatiug "empk vcc co iment ' , if*r example can be 4i pkyed n addition to &e segment 
icom shown m Figuse 5a, 

Figatc 5o siK>^\ s ieeaback nlerfa*,© 42 % <h tcsponsc ai* ibute c >n selec tc 1 \ 

\li,>~>n<. f * c iO' uic* ^ ir j ^teioa^k s -f^c ss -! ows U lor ^uu 
In^-^n.ajon hf ^t^ixa^i <.r; ms i re ^th v. s puomv ^«>fTi rMO 5? dK t 

30 t^^'pv 5t h t i < would I ke U) receive a resposse Segmem iOS indicates that the « e 
?v M asi'nj or CNioiise to hts or Iscr feedback Segmest i 10 mdtca that the «ser >>, io 
example ^ upped i» hii. or I et ie<immg fio^w. or othe activity w tfei i the c mputer 
emsronmem and tiun^ediatelv reqi tre* a response to the feedback ssse&'^age before he ox 
she cati cotitHius' In alternate embodim{.at». addiUoiiid leveh oi pno tj' be added to 

3S tl v tspotxsQ attrilijte h t Allemaii'^eK"', prKtity a ^ g «d fot the revaewei to read the 
xe«dhack and the wgeov % wi$^ A'hich the an jewei is requested to respond to the feedback 
v.in oc scpnaed mo 0 djfftfreju annbmes Simtiarh to tJie srtuatioi eoi devcnbed 
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above wjth t^lercocf- to Figase 5a U^-e fiiimK', d dentin ihe r«.^pos\e icosss 88 cao 
vary dvuafnxcallY with the pamcoiiif contexr, spscsfsed in fselds '57 

jrk*s<...<:c Anubute s^^axait 112 i-tdna Vit. denuu r >, Larnv- o v" Lv 

feedback me-sisage wsll be shared v^lth ao one Seg{i\v*at 114 i\d ^ les int fSjc h m v?r ^ 
3dentrt% wiH aot be seat to a supervisor, boss, or simslar pcj«.>-»n jostxu^.bfe oi tin 
leaiser's departmeat course, used product or h&TsncQ, etc. Segment 1 16 mdscates that ihe 
learner'f, idcatsty caa be shared « ith ihs pnniarj author/reviewer and other leviewers that 
ate m Ihe pnmao revtewerV department, mwkgioup, or other organizational unit 
Kegmeat I IS mdtc^tes* that the ieanjer's id&nhtv cm be received &ad Joiows by anyoiio 
ei>r!r)ecM to the feedback system. Other vanatiOiss of sharmg attributes cm aim be- ased. 
such as not sharing feedback wnh other specif c groups like admtns^r^tots uppci 
managsmem etc is < ^'^m nvt. l^i^b^>Jme''?^. Nhsarv «*ubnei,a' b-^ 'K'-c to Np4,c f\ 
degreei of privacy fo w u mossiac «u Msf a ku4b a iu i*.a£;e ra*her 

khi^fi 'Oi- ?£j£j5t£0" 10) u"-"tHv f^^- j*-v-er senck tbe tcccibick T't<; "f % tncr 

UNtrv. sdcju t> X vOvld select ht ns^<'^<; tti ^ ms u \ o ht ^ u^aai uon 
(Iv-^-c^bcrd aw 3th reference to Figure t 'U 3 i t \ anng rcoB*. 

Bt" c isEj \ »> dsjx&xt tcalh vnth the poiUcu coittvxf «vpcv m iit;U-> ^ 

Fti^ure 0 nHo^^s feedbsLk sn*ertace 42 mth prompted feedback field 7S M'lei'ted bv 
3s Ih iJ'^"'^ «5s.Jvt, ea r&pbvSd b^ t» nrompt d ^Cv^lback vvmauv^ i20 
\\ 5 <i 20 <„ pa\s<i.hs <\ .vf h • iten^s tha. c<»« bi aireci^ ectv,u b\ th^ uncs L i 

co-^n or uput* t i.d -f^k i mx s ^ *r - Ik \ du^s s t bo? vuspt. s^'^nns 

'^ud.fm 1- n? i.n\ia5)m"nt f Ktt iw if i. b ? ! o v OivsJ i 5 ij pic.J 
te;. Jhack %^lnt.in^ i o It Ut vUrsa. t nser napm «n tf> haw d kc'^b'-t,} » i >. 

cat\ qmikh' and dsrectiv s^elect the prompted feedback item v^tthout has mg to mput my 
other mfoimatjo i A pretetivd aumber of the most cotamon feedback items ill are 
d NpUjcd V^h&xi a use- select*; a ptompted item 121, predefmed attnbutCN arc 
a«omanc«lh av!»ignx.d to thdt stem Fcr exaiaple a cnutext in fields and scons 76 can he 
a'«ir*m*»t»calj\ set (O sciecttoa*} t^^socuted -wt^h a chosen Jten *21 , these a^ociated solecttoasi 
caa be asstRfied -^v tiK re\ fewer th, t Didvjdta the rem 121 The ^.eiecied it&m ean be 
dmaycd i« tield 7$, and the user van tK n reject s>etid ivon 92 to send the feedback ttem, 
as aesertbed with reieresce to Ing ore 7. 



The ptoinpted feeahack 121 cax. aUo px^^n^^td contexts ot icom raihei 
than the message comcm shown m Fjgusv 6, Kir ^-xamplc, if msxiy yser*? drs oorcnng 
feedback "di&a&iess" (scon iOO) abom the "do&cout less" cnntcu, botli ico« 100 4iid the 
context "clossoat test" can appear Is pi»aij:^ed wtndow 1 >0 Ote descjiptsoss aiso 
5 displayed m mnd&w OO, saeb as physica! ioeatioas, descnpaou^t oi a product. pRVc<^&. 
or semce, or SsUggcstioBS &om llie reviewer (ass m stems i 23, de-scnbe<i bekw) 

Prompted feedback window 120 cm aiso display specific 5e<- I'm r-< ' : i^x? ^ 
which authors or reviewers want direct feedb^k. A trviewcr c<ui ."jno-x ais uerr J ^ wu > 
the to (a$ well as associated seiectiom for cotitext fields 57 and icons ?&) so that all assets, 
ip ut ispecjfic u&en>, cass see the feedback item d«d select the stem it jt is relevant to thetu 
Review-specific feedback Items 3 23 are preferably displayed alter the commors feedback 
Items 121 m theijst. 

pr{>vKi(rj ;;^iO'^prcd *ccdOa^.k U) u.prs tho'-\«. i u^s ' ■, j«f 

is fcC(5bacK; minibuses fjoju iht. .Lt^us 6 anJ s«i>-s no \w * . . ih« r vnv n tnsssaj.'? *h.^ 
uf^er can vijajckK ohcck fh<,> pto <ipted iccdbfxk xteju*^ hs« to Ui?\>mvtic A Licit pseb'etu o. 
sitggestioa IS hsted. When a pjompied teedbac^c notn is Svicctcd, predvfmed feedback 
attobutes are amotnaiJcalK' «,ct by the sjstem, allomng a uj,er $o qusckly exit the feedback 
mtertsce aud resume tbeir leatamg or other activity. The user tbus "remforce&" the 

20 particular feedback item by adding his her support to the prompted feedback item. If a 
large number of users JEelnfosre a prompted feedback item m sscb a way, the feedba«-k item 
may be viewed \%lth more imponanee by a s^vtewcr since man> us»ers have the %ame 
feedback. 

Additional *pop-rp" v^tndows, ssmilax to pu^n^pi.e i \ nol \ <ma \\ 
15 120, caa be used for other features of the feedback latertat ^ fj^ ^uih \ , a x>?v(. p a m lov^ 
or similar list of selections (not shown) caa be used to present .\ ^^^t ^ a ^t^^u^-y ul 
feedback selections aad iteais tliat the user has* sent ja the past 1 hv u.<. s p lefer^iMy 
select aad review" la^ shown m Ingutt^ 2H) a certain subset oihxi> p*i^t ies<.\-iacL . on is Hv 
de* mmg prcfereace-s its a separate wiadow, menu ll&t. etc. For example, a pop-tip window 
3P can p«^«!em a li**t of feedback items seat by the user which occ«n«d dunng a particuiat time 
h ir.K .wv« a pa.if54.u'aT attrTtjte, have a panicu^ar cmtcxt or have any othei particular 
<,h . .Ktc-istic V hsc ) i)o Use acNjixJ-^ to >50%^ The ps-esious feedback items can be filtered 
n g^eacra. a tx.bite Kt^ite '?t> o? ^ \ *. n o\t iq i o\\r''p'o il iio it f i v .xbe- to 
ses; kis ovsr!> pR'sso^-, leedbatk op s i ijo »t v . <^ J ih sUfgi-Nt^ ns' m .he 

35 M\^ator' vih-jt") ^ttttbatc \\ >ci , faf..^-u^„eM r ^ron *■> I hen di\t)l v ? j 
tbo pxcMOUs iee Iback ax'uj-dsf ,\ on' i x s^r^.'^ ho«'^ rt-* \ > xs . s p-^Ni k<; Jb \ \ 
The Ufeet c<si> pteierablv view the teeabacs^ xer«\ ^i, a hs^t ttcms aiiu v*ai sei<.vt (Vit: J\t 
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ite-ms to view tiK? partscukr cont<sm or juessage of th&c item> 0«e way jo smp3em 
of past feedback k to load past feedback tscok!'; ftx>m & <Jcststx}<«e «f «ore<i i^wds and 
disp}a> '.lK>5.e reccid^ Jbedback mteditce 4L; r^mcval of feedback reoor>K 3^ exnlurcd ■ n 
mo c ik-Tcrl wah icScmncc to viewssg interface 46 Itie tcatusi of ^^eiecnrj^' 

S rev'ewmg p;ts{ feedback itosis cm also bo mipkmeMed 10 ot'icr ways, f^uch witi) juet^u 



e 7 shows fe«db^ mterfsce 42 af^cr a ust-r isas mputk-d specific ssfoMioa 
SO, After a user selects which attributes fdKpLwcd as acorn 76) ki or sh« 

Ifso 

of 



a SO, InHgum7,ak 



Once the tecdDack ^.-omiueiUs ait em&wA ?ho h-^-^ ^ nv'.x' so?xi . 92, \n the 
de!^cnb!?u emb(>dimeat, this seJechfw wdl senJ the feedDack \£t^) the d-itabase to be 
storeti a k>«o d (detailed below). A feedback item s$ ^ specific message, 3«cludit>g my 
, that tlte wser is sesdiag. Oijce the- feedback item sent, the 
i 42 is ifeen preferably removed from the screetj and the user is 
i to his or her "loeatioa" m computer enviroiitaent 48 before accessing 
feedback tntertace 42. In m aiteta&te embodimestt, a user can eiiter addli josai feedback 
m after .^endmg a feedback k&m by .seicetmg appropriate icous arid fteids on interface 42, 
Feedbai,! isterfece 42 can be exited at my time by sefecdsg close box 81, which wiJl cancel 



29a shows a variation 4T of the embodimetst of feedback interface 42 a.^ 
. 4, Merface 42' includes context fteids 57, whkb can be slinllarlj' 
B in Rgtires Sa-d and 4, Icoiss ?6 at« $hown as label ieom w&h imtialiy 
ibute same CSvhat% "who", etc.). A user can select an icoa 76, snch a.s 
sitoation or "wbat" icon 86, and a Bsf of atldbute segments fo that a 
S jtmisr to the situation attfibttte of Figure 5a, Vhat" Icoa 86 includes a question s 
tcon 93, a s 5dc.Ji s.e>;n5«nt icos: ^4, a probleni seg«Kml i 
3Q 9S, and a dis«xk'r e^pnierit tcon U'O Onct- h\. .sinshufc v^g'itciJt Is S 
.segment 5^ displayed u\ place of tl^e "what" kbel tcoti m Alternatively, < 
segment cat? be di-jplayed in a different ai«a of the feedback mtsrfacc 42, s 
below icon 8& 




to "what" icoti 86 atid 
"AboirkonOJ i&sm 



88 and situation or "who" icon 90 are selected .sinuialy 
jment icons smxilar to those ,shown in Figures 5b and 5c. 
attribute icon which pieferabty displays a list of .subjects for the 
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user to select About jcon 91 is descrilied sn greater detail whh a^speci to Figure 29b. 
Messa^^ wiMow 80 displays feedback message cojitem thst fee user inputs, described 
with reference to Figu^s 7, Interface 42' also iociydes a qmt bmton which fmcUons 
simikrly to close box 81 showii m pjgun; 4, A send battoja 92 sesds out & feedback irem 
5 similarly to send icon 92, described Vfiih reforsBcc to ¥igum 7. A cancel button i 24 ojui be 
selected by the- use? lo cascel aH selections made since feedback interface 42' was first 
accessed jj^rd to refuni the tic kli &ud kos\s to their insfi?iliy displayed xelccfsosK. A review 
button 125 car, be ssL^ledesi ;i u.sor t;> cause h Ibl of prompted feedback rcspot-s^^s to be 
displayed in message luea 80; ti^s hsi c:ia he .•icrollcd to d;s|.-<;ay further items usiaj: {vcroll 

10 baj 127, This feature is described in detail wuf; re^poo^ r;^;;:;o A H~/r o;jn sel^--ot a 
prompted itetvi, siuubrly to the wi«d<>\s' 1 ."!(; vh--\v;: Fuusri.- 1>. :.-.;-sci tr^cs- <;clc-ct >entl butto;i 
92 to send out rbe prompted itctu lo tise ;r:orayr k Aitenjativels . a ?.iser cim select a 
separate "reinforce" button to send a .vclecied proiTjpied feedback iterj^. ItJ other 
embodiinstits, jevlew buttofl 125 can be used m display a separale window or display of 

B prompfed feedback items 121 and 123, Is yet other embodlmcBts, a biittotj or fteld can be 
used to display a pop-window simiioi- to window 1 20 of Figure 6, 

In one ptefeixed emboditnent, or$ce a nser has. firashed selecting a cooiext in field 
57 and attributes front icons 76, the- iist of prompted feedback stems is aiuornstieally 
displayed in rness;.n?c are;? HO, Tbea, if tlie user finds that none of the proaspted items 
20 rttatch his or sier own feed back, he or she can dear the pfotnpted feedback fist md eater his 
or her owtJ message in area SO. 

Figure 29fe shows a feedback inteif&ce 42" similar to feedback mterface 42' shown 
in Figure 29a. FeedbacJ: interface 42", however, is different in appeajrance: icons 76 are 
positioiied ro the right t>f cfjsjext fields 57. and tnessage window 80 is larger, Ahout icon 

25 91 is shown being sesecled by a oser, Atoibute segment icons displayed for aboui attri bore 
9; incltKle three tutmber options 126, khelled as "V\ "2", and "3", respccUvcly. 
Additiojud number for oiber^ icons can be added by a revse-v'.'er or operuioi of Sbe feedbaci; 
svstem, or thi; shfivn k.on-i c\ii\ be -eTUoxed, as neccssttry, The>;e :u3n?ber^; cm refer to 
specific subjects, coBtexts, or olher tt^ptcs tlia; a reviesve? c;:n provide for panics ;sar 

30 system. The about icon caa provide further infonnation beyond ■.vbat is t;nccit"icd in 
context fidds 57, For example, if a feedback system 40 is bein-; used irs a business 
orgiaiiKation, a reviewer might w^t to specify icon "1" to designate a stibjeci "cojupany 
procedures/' Thos, when a tjser eaters feedback on company procedures, he or she Ciisj 
sdect SCOTS "T* from the ahout attribute menu. The reviewer will i?BJ)jediately know upon 

35 \'iew?Bg icoB "1" that tl^e feedback is coucemed witii compatiy procedures. This can be 
heipftU whets the context fields 57 may not ftiliy desctibe the suhject of the user's feedback. 
The iK^er can determine the snbjcct that each tiumber references u^jng a mmi or other 



ft3RCf.3on of the feedback mterface, Altej-si^ativeiy, xpccrfic Icoks am be provided by the 
reviewef to describe a subject, such as feiedback ssgme«t icon 127, described below. 

P^^edhsck segmeat -cou 121 \^ dsspirveri n; the alx.ui k;oo lb? v-ith the niinfner icon'; 
126, The fse-dback icon 12? ca» be selected by ths^ issl:;- wb^n UiO ukcv wishes to auisr 
feedback about the feedback system 40 itself. For example, i; a user seiecis 5c<m 127, he 
or she is indicadng to the reviewef fh&t the cumjm mess-ags- is conL-emsd w jr.h feedback 
system: tlie operation or appearaiKje of feedback imetface 42, the cOxdei^cy of the sysf.en5, 
the spe«d of respoitses, the dsfficultj' of using the mterface or system, etc. A.hcmative.h', a 
«ser can select feedback koa 127, md theis be presemed wltfe aRother menu of attribtite 
&cgmm{s describsBg the feedback about thsr feedback system; for example, attributes 
segrnerits snch as "dlffjciilly", "response time"* "appearance", "he^p features''^ etc., caa l>e. 
d:splayed in a horixontal menu of icons exteudiijg froia icon 127. In yet soother 
eiribadirncnt. oace a i5ser seiect^j segment 127, he or she can select my icon 76, field 57, or 
OTiier coritrol presented in feedback snterface 42, A represetstatiOB of the selected cotJtrol 
can then be dispiayed as the .subjsct <?r the feedback, c.^^ to ms'^^.^ge xvijidow 80. For 
eK.'s.mpk, a usct cm select feeviKick u-or. [;;7 ano h^-^- ; „ "vshat' ie<m and the 
'^problem" icon 96. Tbis woti.sd ir.dicaie to a reviewer th-at the u^er ha<i a problem with tiie 
look or ope.j-atjon of the shating icors. llir user can ako add mttssage content lo de.scribe 
the sybjecE of the feedback in greater detad. .Feedback about the feedback sy.'=;ieiT5 can also 
pj^ferabiy be made by specifying a feedback context in context fields 5 ; . Thf. feedback 
system 40, iike any other system, can benefit from users entermg feedback about its 
operatloa and presentation. The rsviewm responsible for the f^dback interface can thet^ 
improve the feedback .system tnore effectively. 

Figure 8.. v. a v , . ■ . ^ :ncr.t oi a ie,.;;u-.- jriejtace 130 d-snlaycd c-n di.spky 
screen 24 ami i;;;! !^^!-:-.-;^;^;. fhe iecdback .system of the prevsciu invention. SHrdlar to 
kaaung iritedacs. ^h''\K-n m Fjgtsrcs 3a-d, Icsnier irttcrtacc i30ca.n be inof^rjr.oraicd ituo 
a learning or coi^pt-ter ^siVironment 4S showu ift Figure 2 and used, for csJUBplc. within a 
.school or sin-iiiat^ educatsonai system, JLeamer bterface 130 iaclades display area 132 mid 
icQix menu 1 34, 

Display area 132 is used by the learner interface 130 to pt^seni information or 
ct>t3rse niareriat to a learner. The infbrnuttifjn C3.r; preferably in the form of texL ?ouiKi, 
pictotes, f«o\-5es. ek;., depending' on \hi- k^mf& preteretwe.s. Tise learner c;jd vjew 
informatiosi preseotly off-.screen by using a scraU bu- or sitrtilar controls, hi Figmc Sa, tite 
kattser has higlilighted a word 145, "Galileo", with a pointing device such as a mouse. 

Menu 134 inclndes several menu ict>ns that offer a learner choices whhitt the 
learning environment. For example, one menu choice is a "qjiick reference" Icon, which 
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piovjdes a 1 of j£tferei5csss and oU^tr iooh to ho'^f leam aboai lexi ot other mtcsmaUon th<it 
the learfief has .^ekcfed m dr^pUY atra 130 A djfu're x mcmx icon ca« pjovide dsfkrenJ 
-or'--'-, -kr^^n*^ Cff <} N«t>fect *o kame? s^ekTts, 'cuch M a practoJ rep s^estatsoSv the ccn&al 
^J.a i 4 LK> s.\-ix*cu hiN'orv' ot the ^ub|ea, etr \ ditTereat menu cai? asM^r the 
S ico^^ f h< 'N-jugatm^ through dtffgT^m c*-*nise sabiei,*.^ or (heir owo loammg hs&toiy, 'rhe 
.tr<3-rer i>- tf> select v^iom icoa menu chotces for my ml ject or topic he v^r she Is 
leaniing about 

in FipiK. 8a a stiti.t\<m of tot frois which the ieantser is leanjKL uj^^Lsvd m 
dtspl&y sx^n 132 The reprcseatattoa mode Oiat is being displaced ss, prefer«h(> sho%n 

i0 sepfeseatacion icon 146 wfeih m Figure 8a mdicates* th&t a 'Personalities' subie^t i*. -temg 
displayed Reom^entatioa mode jcojj 14C! mdicate& a specific pn^estdttoa <;*vie ihn the 
kanier fess selected Per^souaEitics mght mean that the learaer ^mhcH to He prescsjVi.. a 
subject f o i i tx-5m < f %iev^ Lt^Jtonca ?>fi<:u'-jii<Uc^ of ihe suhr^ Ihe ICimca has coiac 
a^r I f ants irnjv pfom<.u n u aj^d rja& hj?h igY< a the word 

IS C<» ^ sn K a «u ci' '•^fervn^c menu i Oi i ■> i -'Kms i ^ 1- o n ^v*. ^ '^^ti.si Oi\ 
b J ihJ i d h\ \he k u nog ^ n irs^ust v i sn h it 'hv a nexus <.ub ( <. ^ -\'n s lot 

iv.e t'Kc ic^n M^-f sxhefi iinJ ! ivo 1 ^ e red i>Uv^ van Ks^a^ mt (.a fo- 

e,\<'mpe -5 oiiogxaplucai sco , 14t) an e-cv doped i. icon < oi?«b^a (O - 

^ leareer can iihoose asv of the !!iUb-icom, which pt«^«,rab> «H prc^tl a uxt t, 

&«b-«:Qh-Rons The «!ub-M5h ico ^5. t stiev. sd x-vsH ocjtonu a tuncno-. iE^u.ik 
applKattnnpiogt^i^ dHp 5\ xm\ rn su fuoiJS,ac 

t ifiin- Sb «'ho%x s ! « SK t i c f ?ef the 3<r o vT has seie<. tti te !.'b Xi k KCft 
144 m list i5h feeab^ H s I i h h c to m i c k u >^ *s icon <,v, <„ n W 

f Of •^'^i vi! Si \i.\ti<^ \l >^ lh<. h ima i. al r <*'^oC'' n hK'i n v 

i<?edvv,k IK Ic-uoe^ r<R sc' e*.t tmv *<t dit 't^oHN m ^r ^< u rt.t^bat^sdj ur^ 
tb t d^e Nvkvt^^vi ivou needs* *o be presented {t* tK 1 'i,t hs ■'^ C r hi i-a^ i *,i»vko 
oa^. of K^»ns I ^ hst ' to Cinu^en* or one oi Jhos hops f>i ti v jcaiJKt ca' ^ei a 
^ another icon m m&m 134 oi an item m display «iea 132 to enter feedback on a specific 
subtect or icon. 

^ J i s< o ^ -> icwm i ircrace BO atlv," i leirn^i ^ j-. (.1- vi m <, ni n 
\^ <MJ siiKtUv-^^' r *i ex,, npl he ^ ( t I v 'onv 5 mi <i ^o u 
Wee H ' is.r^ 1 un ov ^ ^ 1 ! \ <. o^ u p^ ^-s o J s > a 

3S ~ i n \<l'^(.f"ds o ^ rr ' sfc^dbvU-lv v<nnvivm 1^4 lo sdIuok tU sub t,<,( ti =■ 
tf '1 -\ vFcnu^i^i.!^ i\ ^dbavkijile--fa>.ec<t* be <S!splavv-dot»tl5c entire screen 24, m 
'A msxim eox, m a maaow, etc. 
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1 V ' ! ^ 5)pr*c} b-^ ^.^ ii^.iiiojTUhrecdsneiet}tkeabackt»odc^ Mode iC*»ft 
^ ^ n iji? i, >ul ?n k Mf}(i& icons iticlunie a teedba<.K Kor I*?? a 

I ^e^'" tt aoi^t b\ M.ieamg mi^lr scon i5t> v^bickj?rt uribis v^n-t^N wd>. 

l5<. X { or- i bv di^ipkscJ ".mis;, ioiheKom .DntJ<sgun, 4 Ij^Fj^iiv^ iecdbf ivoa 
157 has been selec ted 

Representation icf^a 14*? j\ displayed m teedbsck vimdoxi. 154 ajid sho^v** she 
c> eat icpie«e»taUo« mode bemg disp a\ed ir d play are^i 132 as mdica v.d b\ jcon t4t> 
Representation ». v> 14", related ico 152, mid bighhghted 'wcfd 141 in ds p! i% arc^ 
10 thu deBae ihi cm ext of the feedback lUm F o jptcd feedback tidd i58 ^ hcit elected 
b\ I e c i -t r pr r b V .nj^^^ - ^ indox s^msL- to w di. w 120 of Figure t> lo bt 
djNp i\c1 I jt ^ t J X pt, II Into ahi'^k itc ftat t.^ be Anrctlv dmtdb-^th 

^ ^ 5 ^ k c? I c-n r tUI i l^sissit ht 

15 ti cto n I J f^li ^ J i \ Jt c 1 1 t h -s. " or r 

a. cn c-n-i ^ n { 1 w c * i uh u t U ^ t T 1 ii t t I i 
v.asiuh5jhkd f fhele c « umLv ^n^M' *(dw uh {s hv «,iib a ne 1 im. 
washes to eater feedback about 

A.rmhnt'^ ico v 60 dj^, k\ the curreatH selected attnbutes for tbo teedbaci ite n 
D ihcse «a buus it smv to Xhft sttf fe«t«% described m Fjgy e«s 5* c a«d prefs-ibH 
nek i. ^ i N5tiJ*tt 5( f5 •! k J on { ^ 5 r^s'-^o'^v , ib tc i on ^4 ir ^ nr ^ i\ i.u& 
KO Uv-! Th" L s o'^ '^fd -(K^tf^?! ^\ i ^ i \ \ > 

^e:rm^''ts to Usn It n a'nbutv ists s ov. ua F ^uies ^ i t tRpi^-^t i(jS 
5«» «s c tnf r xc fi c U t.om or mes'saaes, aad ss, '^stmkr to ms%s&g<, 
2S Window ot fsedoacK mtertace 42. 

F £;i3re 10 shovts karser mtertatc 130 di pla>mg feedback -esf ndo^ i"4 The 
V - h iN s'-lec ed *5tei ttrsbtJte toa 166 A vertical I \t 16" of attnbule NCgm-sKs 

pi \ t i nd he ktjnst can select the n mt appropnae Hh&nm attnbutg tot ibe feedback 
itcn Ihc o h^ratfnbut uoftNl^iic plr^ simdarl r^\rn\ c <, 

I t i ^ i. ca <ii«thv>rs J ot£,N aon 1*=^ tto i ih« i^O ihs. } - \ i i d tic ? 
r tnnxitii. « 1^9^i«lhc mode icon n6 In^^cmnbuti. ode L^v ?earni,i c sn mpi t^< <i 
othtx forms Oi jjtonjiaur^ni .hat they w b (o idd to dw co rse s, r em iro imtnt tr*>m which 
th^.'v je-instjo A f^Me \et can v> eterabiy -vsew tbe e eo tobutjons ,n the siewmg 
35 1 irtiJavt 4i? dete'^me it the von nhat o«n n: v» o th-y-hiie nd/or U th«^ apjjropriale 
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Figure i: 4? TAN K irsi. < - < i -^j nd i - 

5 the ^essme v<3j mput mfornsatojs that they wislno h ujt \ hot -id <, >u ol J ^ 

^ys>tc , or the authoj/teviewei General eomnems, sugars to s ot pionk ms \-, tb ^ 
speojfii. ttoi or father .wbject b? sent a fc&iback m tDis modo, 1 no tecdback car be 
sent With the i*ead icon 151 Once she feedback seat the feedback -ft'ndnw I 4 5s 
preferabh cmoved Lorn ths d '5pU5' a»d the iearuer cojjfcnue^ ■«jth ti the leammi; 
IQ mviimxixmnL 

x.eru^.a^l\t i ^ of Ftgt re l^^a Dssp'ix ^iw '"Od.s^l i ? f hu t ! m 
IS tcsf i?5 ic to ^clecU^g ihe biographicU cor 'hs h'f j \ < j 

rep csenti ion icm 1?l Ptcturs? do^% 172 ih <. Ko ii^i^k \t.d vv k n i k i. ^ rc H^iCt-tCk 
the bjog ^ph cal icoa 140 accoidmg lo the learner's preforectco" The p cmre wmdov. 
displays a ptctures reieyam to the selected ^pnsseritattoji a»d subject. Tlie learner has also 
jus*t selected f^dbs*. k icon 173 -^hicfe is located m tmm icm. raena 1 '^4 The Jearner can 
m nov^ s.lE'ct anv word or ^enteace m the text israh ^ foedbadc ctit^oi (showrj jtj F ^;ure 13t>) 

ea^bodi-aen ibv t.anis.< i dl v iHw^oncKx n hcj fon,.^ oI pi^^emeO !«toraUbm io <>er3d 
2S feedback ^bouL ^«r example Ik) picture, oi a portjon thereof, dsfepiaved i picture 
i«>dow r'^c-w be vtected ot bigMighted to enter feedback &boi t the pjctu 

K H N,io\ss Ic^mi. .meitact 130 ■v\jth ktc n.Kk x^'->r. ^ m p <. 
I < ^ T *^san-^ di^-p.a^oO <• n the rtor j m nis i^ph s a "4 o ^ < v. \\ 

X n 5 1^ s3bK>. » ih ft 1^ ^.k xTO ! ts Iti, 1 1> ^ il \ \ ^ K s^-iO' 

' i,^B£;'Xvate^' ioMo \' t v ^unvt 'xjcv.ir^. fku ? Ss<.k ^ov'^ 

i^*, CiitCv I U" htr isxdodcjs. into 'dCs, is iSx i«edb t^k «wds, k(. prrsv '^f )^t\ k 1 +~ a hv,^ * ■> 
tliat the kamer \% m Personahliess repre«5eiitat oti mode Icon lo" . J v >k .'r>.phjt,al icon 
torn wmdow HI and t C'cate\ tbat ti^ s tecdback Uern conceo \u<i i-^^^ m mfo matjon 
3S Pio»i pie4 feedback fseld J5S attr'^ute ivonH l6tJ iind tnp m a 168 ajc used m tise sanje 
wav as described wish releresce to I'igur^s 9-12. 
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Figure 15 is a schemadc diagram csf a feedback record 174 suitable for use in the 
present fevention. When the user or kamer selects the "send" koa or a sm^ilar coj^hroi to 
m-i!catc he or >ihc is fuuf^hcd and has sent She ente,t^,£i feedback item io the feedback system, 
ihe Uchh of u mi-x structtuc, such as record 174. are filled m with the feedback 
ifjA-rrrsiUJon, Thk is dcenlbed in mom detail beK'j'vv with st^tcrence to Fisjore 20, Record 
174 is adaux Mroctt-re that i:-^ scparats- fead independently sis^red froro a,ny coruest ^A'hk'h tbe 
feedback record may reference; for exatviple, record 174 is sot incorporated wuhin a diUa 
dc^tuneat wUch may be the comexi of the feedback urfotm^ion stored withm the record. 

Reeiord 174 preferably iacltides & header pottiofi 176 aad a da^ portion 1?S, The 
header pmim isciudes several fields tfeat describe and qualify tbe feedback ixifornjatiort 
which ih& aser sem. Situation attribnte fieJd 180 is preferably a byte or other ai1eq«ately~ 
sised storage sxm sufSciest for stormg iafonaation describing which sittsatiott attribute the 
Lise-f selected. Response aaribyte tlekl 182 and sharing attribute field ,{84 srs similar to 
^utu«lon attribute fidd ISO in tlm they store informstioo desedbirsg which response 
attribute ar?d sharitis^ atfrihute, respect jvely, the U5s-i ^electcJ, Srusrhi^ contcjn field 186 is- 
aa t^ptioaal fseld that c^jn be -sfcd in ssj alternat.^ «-n';\x,iT:.or.i >i iw icedback j;>stcru xn 
which the oser can specify by na^-jje which aumo!>., rcx iexvct^, i,-r utijc-r karner,-* car? view 
th£' feedback nse^stige. hi stjch an entbodiment, the sharing content tlesd vvculd contain the 
natnes mdlat identification ntjmbers of the itidividuals specified to receive the feedback. 
Other attribute fieids IS8 ase Seids that are used for stored additional attributes describing 
the feedback or the user. For example, te^halcai altfibmes 512, organixational attributes 
514, and personal attribt«es 5 !6 are preferably each stiored is a scpH'ate attribute fteld 188 
of record 174. Other attribute BeJds 188 cm also be used or ctsstomized for additional 
attributes impiemented by a particiskr systetB. For example, if a particular school system 
found a used to add as attribute for feedback de.scribi!sg the level of trnderstanding achieved 
by a learner about a particular strbject, these fields 188 in feedback record 174 cm be used 
to store the attribute dats. 

D.iSe field i<-50 .stores the data defmitig the date and exrtct tnne when Qx- tiSvr .ser^t the 
lecdbaiTK tnessage. Preferably, this k the time when the user actually .sent the fr-cdbstcl:. 
i.e. whsrt sejid icon 92 or 151 was selected. Alterrsatively, two tim^ cm be mr&d in thi.s 
fteld: a titrie itidicatiaa wheti the user first accessed the feedback iraterface, atid a second 
titne indicating whert the user selected the sead Icon to send the feedback. The amount of 
ttme that users fire spending to send feedback could thus be collected m6 reviewed as a 
feedback item m i;self to deten^r'sie r^'ii-.' IV.N'h-.o^ ^VNit-n! needs iirpr-n^^tncn; 

l-ocation/kleritJty fieid 1 -s-'>-!^s uvsu:^ <<f tru usor \sh!> ;i^i(du\£r ths 
tee P'<3ck .-\ u.NCT can be identitlcd in ^ e-ai v a^ s I \k -)f -Ik user o,in h;- siorrtl 
as the kx;ii5iuii of tne nscr, physically or \vithuj tite .^t^ucturc of tho orgon^z..st:< «u where tiK 
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mmt actssled itnel uf tiie locafciun c^n be osct Ktua. aa^nv. I be- ii>,c{ s (.entity t^n 
ako be sooted a^. an idcntsfsv^lsnn aianbej Mich a.s a srudotn mmb^x -ensj-iio'vt;*. isum^ei 
etc \ computer tennmal {dentsficauoa min>bcf cai ai^o be stored e %luch ^pcvJt c 
tsmiware mpat mterfacse the ieamef iS usma. 

Context field }94 stores rhc ^oaitx ($n r ^ j inck \s ■^tiov^s 

a'jm e n teedhatk mtsffaus 52 the cortc^ ' ». \o V impUucm^ ^ s a ns'v of ^t<. k s , k 
OK. ^ alx)«tapa£tK^ularsubiea eauh&ujMategoif> 'seteioii^ 5 
^r- ersc is s«ch m mbodsjscm, each categon or ^uh < at(. ^< 1 1<, >. s b>% 
a&sigaed a speciff*. ide«ufi«.£tio» niimber whi^h lelK the iearamg enviroumeK' or othes 
emiroomeat {fee idcatm ot the categofv Cdtegones can thu^ fee mox cd to diiret^at 
cat&i?on levels >et hhII be idtatjfieJ b> ths sdentiftcattoa number To store such cate^^-^ne^ 
in come^r field th? If> Bumben* of the categotiev ma> be first Ustcd, followed b\ the 
nu o <ilpinn i« t ch*.ra«.te the category nassicj^ For example as shov>n m Figure 
^onc^xt of tic iSi. as j.hnwa m Figure'^ 4 ? stored m context field 1*?-^ 
ide^iK^jn-- n>^<.r !6 n 5 « f i ons^nrib KveschLau >rv <.ho<*en p ^nctab^ 
mih oid ol Ki»jM J i t i i-n hoik i niui l\ r xndivai^ a 

fut^t ^ub c<Uv,^orti"*> -j^ iL n t ? t « c mL).!,itkSvN Ihus ^ (.is^-rxd 
cmboonier> 1 triMmur" ^ I u <„5e^ n s an V spt. c 1 ] o h'^ 

tm£fOdifx>e«t*> i> iitlerfut ma'^i ^ n in ^ m \u n\ k ? ..sua! I 

memm cas^cinci San or 1 hi s \k i ua o^i 

order as identJJtc ^bor rttimbe'-^ soll« Ftciiai u s < <. 6\ UMmt to 
"381 " etv Bad of sinag ohanctcr^ spscity ent,' of each <?tiiag same <Md asf «sl&.o 
asjed to mmk thss iastthnee imused kveis of categorjes. 

Tli^. context o*" fvt4bavk can J^o be N-Jt.t^fjcd MO\%n the Lius nun 
ex h ixn 'tl Oof j a s^^. 8 H instkh m^nbcitna^ c<n*txtca£5bt speuneu.-^ %tU 
^ i ^ s« D V.I XX -iN sU v\ t u a! 1^ i 5 \^ " a^h lepresentationdLl Kon and 
o*na evted SvO ^ o ivt 4»» ID aumln?! a^socsatet. \* nh men 

Object Kientjfter field 200 5j» an optional field that stores m objea idemitler which 
refeteacoN an object the ut^er xbs^ be retweacm^; vit& hs'^ or her feedback mformatjon 
b\'«np'es c?! objects, inclad? a pace of material m a «.«nrse a •^rstenct or %ord on the page 
^ air<i. djspl s's.ea t n She scrtvF < mo^ts elv In tbss dt.s<.! '^i 1 > !ol lu i'^^ <^ >U\ 
v?sxUuNtd ^ ik^rnLta^ (.n-v n.'>amento vv\RTn i s ( fK nuoi n ; x^i « i \ tb 
iu f-ii. I v)b a-- '"I fnisKi ri^-jx 1 -^xk «. u U i tic 1 -r n t ( 'o^ ; '^t 
ix r >,f^(. i k t:!"tce s *v k i fo *i t tm*. 1 >.vn n 

K t.nt^ t'^i \ s lu ( \ \ \ c X J sb - I 

Ui- xin t r n d s ^oivt X xu ^ x >. x t ^ < f ^ j „ ikatkuuox 

nix x-- ^ jiu •vK^Ki. m tht ceaouk ■'^coxd n t^c uoKct latjjiiuc* scid ( n olx'v 



embodimems, {jse page or other objects cm\ be stored ax pan of fee cojuest J 94 asjd/or a<J 
pan of techakal atoibutes 512). A rsvbwer viewing the feedback recojx! dies knows 
which specific object the learner was viswis^g at the ima of feedback. r« m aJtemaie 
embodiment, object identifkr field cm aiso be used siinilarly to ideatify separate application 
5 f^ograjjis which the le^er titay have bees itmaing wiAin the leamiog system, SDch as a 
simulatioji program, a tmonng pmgs^m, etc, 

Si5h-{)bjecl Klen$.if5er fields can he used to store ideatifiet^ for sjjb-obJs?ct$, if stiy are 
a^ed, Foi exiunpk^ if an object witlmi a Jearfliug system defined as a page, sub- objecls 
cau be defined as certain sentences or words on the page. If the objec? a pich)re, sub- 
10 objosts ca« be dsfiiied as specific ^as oa ti^e picture, or evext attribates of vix- picjus e such 
as color or t^solutioSv Alternatively, ideutifierSi for sob-objects cm be stored after parent 
t^iects in the object ideatlier field 2(K), 

<\utbot tiC d-> ^' 4 ,5 c I v?ci ^ !x I s; ^N«r h^-^ s-^^t >^ss 1-^ l-ix1b;?c}r 
dXid hi.-- v\ t,i thw ^vcbs,v\ it \ « p r J h ^-^ >i Oj>u s u ^ > lo fiU ixx 

IS these U£ u-v hc'>.ri ih<>.\ i V * ' i uaiJ-^as hioA-*' i^mhor 

*"e!d'; ?()•* rck3<,''c ^ li i n u !.es;u s^'- * d 1 > %vhu > an deatlfier 

referencji^g the respo-'jSib'c" person ior the toedhaci^ h\ xtn. ocjsO-'ibea e^nbaa ment, a 
reviews?! can preterabl^ specify partKaUr per?p t-^ oxf ^itjatiors -^^ao ats; rc*>poiHible for 
s»pecif3c context*, cotsrves topics, mlottiiation groups, etc of the leammg em-tronmerst or 

Z> coiiaputer cavHVsameat The CPU U or a different CPD xn the teedbacii system accesses a 
separate hstmg or database of tesponstWe people for various conS^xtj. The context field 
194 of a *;ent feedback record is exstBisted and a responsible persoti xs matched to the 
contex Ff>t evatnple the head of a phystcs depattmest *ran he designated "rcspoasibls" 
fo' J \<'Ah>xk cclaipg ts» pb%sc<J Ih^t pc--sf>r's. identifier J-* -^torevi in fie^a :06 of 

25 tecdback record 174 Othei people rtspt^ti^ble for siib-contexts of pby^tcs can also b« 
Mted in field 20§. 

Responsible per^n organjxatiosdl identitier field 208 j^tofK m iti <tM tor the 
respoasibie person for the feedback record that identifies the rc.>i5x>.ni,3bit. pu^^on » place 
withm an organiyatto'^ For example, the respOQSible pej^on may be an empiovee three 

^> levels dimn from tbc man xgor of the di ViSion The employ ee'<; position in the company's 
hieraix i ^ s re^^-v. te^ tn he icienti xtorec m ttcld 308 The CPU 12 or a different CPCJ 
m th^" ^--el V s\N(er- <>.ccss"n m^^rma^JOB ^'ot^t^d isi a s-eparate database that mtm& the 
tc pvJ si^ t i I' I ! vs?K n ^ ID mb-^r s hat 10 s i .n-Jf i ■stored in 

tkai ^f^-^ 1 ; ^-'^ o p tn^ V c< "0^ (i..^. pa>.3 . <ml i .some 

35 embod5a-tej5i&, no rcsiX>i\sible person is assigned and stored in each ieedbacic record- 
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Sender orgmwsadoaiti identifier field 2H} stores an idonnrser tH.i R^enrjfks the 
users poskion mthin the orgaruzatkm. A CPl) usses ihe same inappuj^ >raorixiatk>n m^4 
fox fidd 20B 10 map the- hje-rarchica} position of the user to aa ID mmbau wbich is thes 
stored m field 210. In other embodimeats, the seader's orgaalzatM identifier can be 
S stored in location field 192. Or, orgarnzationai attributes 514, stored iji other attributes 
fieJds 188, C8R be used to specify the usefs position wltbin aa orgaijizatioa, 

Fkg fields 212 store specific fkgs for feedbaek record 174. Two nag'< m the 
preferx^d embodiment ai^, used for a read status field 213 and a cieared/closed status field 
214. Read status fidd 2 1 3 slopes a flag that indicates If the message of the feedback record 

10 has been viewed by the responsible person of the feedback for other reviewer). A reviewer 
thus knows if he or she has viewed a feedback record's content. If severai responsible 
people are indicated m r^sspotisible field 201 th^ a lead status flag cmx a.ssigried lo e^ch 
responsible person. Cieared/closed status field 214 stores a flag that indicates if the 
feedback record has been deas^ or clmed, v^'bkh means thst tlve issuers) that the feedback 

B raises have been addr«.ssed and/or resolved. A i«viewer caii thus clear a feedback record 
oace h& or she has viewed it so that it is not on his or her "to do" list The deared record 
can he stiH accessible to other reviewers; alternatively, the cleared recwd can be considered 
tmolved aiid liot accessible to anyone. 

Da^a por^ton 17S o( feedback secord U4 is used to store the actual feedback 
m n^cssage that ih^ user has inputted. The niessage data preferably first include.^ a ileld 
ifidjcatiag which mptit mode the user used (keyboaril, pen, mieropbone, etc.) so that the 
data can be interpreted correctly. The actual message data can follow the mode field. If 
text, the message can be stored as characters, arsd any other form of taptJt can be stored as 
bits. 

2S \ ^ 5 J^u t v| Ltu .tf' { ^dvjv fvi. ^ b J? m m b< ^ n 0<- <. s '■><, 1 as U*, uu 

^Loukl be . ppri. t ii^i. l-.. t <he aai^al Nfras. «-e ot tnt ti^ k Kui 1 n s r» m 1 - s 
x%«\in tH- i.op*. of tic linentjor; Itt M-»n5e embOv'it^t.nK ' hr^^x; - 

Mens cjint'\ educe tne sue ol ta-«d thus an^ount of ituoitn^tt is sto.cJ ns it e *ee«l\it-k 
n?ma "In others addtbonal a»d/or dtttetem fields may be desirable to Ucihtate a ^p&cifiL 

30 purpose, 

iij Figure it>, display screeii 24 s.hows a tlrst er) xx m r? ^> < u ^ i ^ ^ in 
interlace 4o <r eedb ivk v jsu ili^^r Wx^'ch dispi* \< I 5 t'x w ^ < t^f. 
sYNt^n-* ^hi^ \ I i iattrv i Iho vif'svnt m u s ^ p tcs h si. \ J sss I 
disphrc ^ i to b < e^r^-^ 'kit sus %u\in .n^r^n'om^ 

itnei av.e k e aa. J asc oi u^i oa^I c^otvi^. < •* s^.. ^ i 1 H s <. r - 1 n ? < i 
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viewms xutertace, Tbs srfjcess is luither detasled with respect to Figure 22 

ivt.t,l «i<.k a 4 iso t^ c i ji, is, 3 5 rj linsn O s i \ id 
5 '^i.r I p^rkiu '0 cc H k i k 1 « khun i s avi 

patterns m teedback By mrfkiag eiectio i«5 m the v ewing interfc?, the re\' e'act "ho«id "-sc 
He to effectively choose a p«c t c subset ot feedback rtconis that are uf tn eres« to tht 

fcvievs-er then \ e^ th*. pattesrs of those &cieccea foedbacK rscord Hwia she 
10 *ietoed subset o1 feedback recordss choseix by the a^jewe to view s kno^n. the 
c n bmed <jet of feedback sec* rds Use $&.oad ievel f jutonststaon presemauon a 

more pec t c level, j f^kidh pamt,«iarss abois erch feedback record can be stev^td 

anslvaed, and responded to. For exasnple. m a kammg envsroumeot, level wodd be 

more often «Ncd author^ and teacise <. lo er to studc ts seadinf ieedback md who ha^ e 
15 n^tl du ct \ X. fh ^ iccj ie feedback ssucv V e vin^ interface 46 preier&biv includes a 

iK nu \ rUo\\ 2 ^ ? L mesi msdo9> 220, a tiirte wji5do% 22'', o c or lojv a*tnb«te 

s'i i ixow N „ 4, an»5 a fnijs*. w? dow 22'^ 

Locauon. conteM and time wmdows 220 ssjd 222 are used by ths reviewer to 
specjfj from ji^speettveiy which t sers o phy cai WatJons. he o she v^-ant*; to \iGv> 
20 feedback ^Uch co text he or be wa ts. the feedback to de oibe, and sii,h\ih tixw period 
i>}r -wh (h h< oi he V. art the x^ewed feedback records to ongtnate Locatt^n vs-uidovi 
2 i S *s sjNtd to N'^et.jf'v d V pb\v. V J xocat on i qtr whis.b feedback data mil be preheated 
ihe V mdo^ neludc<; a rut^*><,! c f lis "^^S v. hi i ■^t t^eJ ^ -sn^rnss ^ i ittsr'* rht 
s'uat Jo ai on I'oi eccbavk ? fit. 5 I i s h | sti i t -^m -^so^t f,f iKti 

s fK'( w.eu i.t hm\ tht. or hn of H k icJ kv iKvve ul si '^i r r 
M(^£ (cnni* i, CvJ lu t2<? 4.unOu' in O' it: endKKxSrx ^.jiN Jj>.pr\>su< ^ t to 01 <i 
30 can be vpec bed tn context mndoi% 220 m a dittere t fo m ot feedback context la other 
e'^ibod'n csts \v isdo^ 218canbe3 pletncmcd to spec f> dsffereni uver atmbutas, nchas 
Cigaiii?ati>naiatt3ibmes514 tvchmcaiamtt>t^ss5l2 ajidpers<ma1sttf b«tc\5A6as lo^n 
m Hgum 2S* 

}a ii^ shat ,x .^s.T L.^r- ?f-. u-v \ <r ^'\'V^T'-- -i uno. .^'OrOit'cd u>t:r>v; r r<KCv.krt;v; do\\n t<f 
d- ck -oc^u; tcsi If \ as sr>owi) m Hgincs 3 7. a re\ itwcv cdi) sjiecuy Jo \ sew toe.r!\i.%\ 
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combined set of iet.dh4.ck (\ cards pnf<^n>t^d to the n.Me%ci It the jv^^ewei >>pev.SLf!ei.4 cnh 
' fe&ti g i,«secona caujgor>) .md left ihe m\{ Osec f dds blank & larger a oa' i te'^titja 
ieedback data wo«ld he mciuded mttQ combiE ea xeu nciudu tli^ C.« ^sout 1 « tmh 
i^tegoo ) teedback Ai. ssho^vst m Figure io a cotitex of "Tes,hTiK^ lestuig' scievted to 
kmit the vjewed feedbfack record context to "Tesfesg." 

Time WiKd^ V 222 di*ipkjs she pre'c"\^d n i c }v ma i.\^.T wnch the icvmwa 
to exsm e tcedbacic The sevjewer chaage«> urrc p^^ran c et XkUu. 223 to npe;. fv a 
tsmc spa« A gf<^h 225 pictonaUv displays tlie d stnbutst n of feedback me^^s ges* tiut ha\ «, 
bci^n reccsvcd over thv tj tie pertod ipecifted n ticlds 22^ \^ith the m t uxm of Teedback 
ecords* bemg i dic» csl t. the vest cat dstei^toa Preiersblj he graph is onuiiv.alH 
scaled to ¥C!ticall> aad hort?>otjtall> fu nto tk^ \^ mttow 222 <iCC0j^img ihe spj?t t fsot? ^ r 
&pan ai d tiie ammnt oi feedback records One ot the f eids 221 can be u ed to \p^cit\ ihe 
jbo zoatal resoMuou ot the graph h,o ihst each hon omaJ dM xon repres a t a^ i 
month, a w&sk. etc. 

AttnbMw wm<»o%v 22- pwsc«f* giipli.c«. rep-S'^etsiaj'on^ ot J^-s. (>. b ^.d ut 
feedbat,k that the c tewer hds selected m liae v eutng mtertaee Ihc attt 'bute v\ iflviv, ^-^o 
^iows a reviewer to pattactdar attribmes ^foch he of she would hke feeth^a -<cotv s 
in the con bi»ed set to lijclude la the desscnbed emboditrcat, the attfibutt*^ orjaoixt d 
to the mmn attribute categones that mav be as* jgned to feedbadt Isi Tipint k a-c 
three attnbatc*; (i e «^tuat oj , sharmg aad response) -which are o gantssed into sxtuatk^i) 
;>'0»'p 228 re«ipOx &e srosip 1^1, ard shar ng groiip 230 Each atinl ule gvm p m s^m4o^ 
224 n.x.s^^Ts.'^ eavb ot *he possible cho ccs I e ^ov,n as, " egments fo that attiibtUt 
v^meu but.oi 2M preterrDlv provided fOi v.ach 'jegmei^t aBd c8b be to^J*^^^ 
He <,u <.r sHv, t.<.svl ( e , sdcctcd o Jt.<;tlec*!.*„ r Vv as J 3\jo« t ttu' 
^ J i>b(- f5fi «c H tlic fexie'Aer In i sr. l<-> d 1 ssr ois 2 i 4, n s 

TskOO -^sn^clut n ; »o o 1 - cCiuI u ^d ".t rl I 

r i uck s I nt\ 11 <.^a s h n * a uiUj «, ^e..,ms,j-! rs^ 

luoc Kt He i,f 5 b t v( i H k ! '^o ^ s 1 V f St i ) a I N*atu<5 oi a 

s<. -mem s pa' ^taS \ s^^os^ o -^s hjghi ghieu v\ vi x iishku {<. ^p<. ux 

*i,t<nb'Ke viH^dox^ 14 divpl^v"* bat grarf s 2'^3 above each oi the segment bmtoti 
xc Ik n')!^.v,)Kh5 {"^sov ut,d utL $J X s eai s he vertical length ot each bar 
1 pj. I ^jvj ^ ^ {",h. oed lack iiev, Olds,. ss^x.tated'ft.ith the segjnem A 

i) ^ -^^ I •> ^ b\ I \ ( {> I ! !j ' I ! mdi aistic nijol i o ii^<.ub! I 
J i s \^ h s\ ill ■> J t . t le.sdbK''- ! <^ i. ii se n 

.s u ths<.,k^a \n u>d iica b< r t^rjph pa ter sWx di p a%cd tO' ?a unche^k.*. l ^n^ 
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indicates the number of feedback recotxls which mil be added to the combined set if the 
segmeat is checked (see Figures i? sxtd IS), Alternatively, ail bar graphs Ci«5 always be 
displayed as filled (or usBiled). ajxi segmerst buttons 131 would alone i«dicaie if the 
seprtent were checkeil or unchecked. Ijr m alremate embodiment, the bar graphs 233 cao 
S be selected or dc'se!ected by the nj^^evver to check or oachcck a segmerJ instcKi (or m 
addition kVs selechng segn^cnt burtons 231, In a different emhod'-oifin. b;a- clunts cuii 
represent oaly sbe number of feedfosck .records that wUl be subtracted from the curnbined 
set if the segment is tJSclsecW (ivO,, all unchecked segments wjil itgve a zejxs-kvel bar 

10 In Figai« 16, all the segEnessts sto checked md thecefcere the feedback records in ihe 

combined set mc oaly Himted or fsiteted by the location cotttext, m4 time v. itidov^ s Foi 
examnle, situanon ^osip 228 pre<5eists the five sicuattoa atofoute segments defined m 
l-<gu.c"5 ^ Tbctt. arc r^to feedback records having the '^nestsort' attnbutc ^gment thit 
s'i-oulJ be "vubtra<.ted jt the question segtr^cpt were aacbecked i8 ieedhack records having 
the sfioi afc ibnt'- s'-|:ftiau tha* v^ojld oe saHraUc i, et:^ In etwt, a chei^kod 

i.egrtx'^v vfiPt^- b ^'■^"^ hos » ht. ..-iio 3< ' of teodKu k u\ o in t. v. con^hntd se uu 
melude >-!'«' -^-'eni""' "^mv^'irv re-^non^-" f>'-ou>T 2'^2 pre-^e'-^s t'^e respoxsse sesTn^eaf* 
1^1 h\ <.r ^ i H! f^td'^iv.- s c1 \ 5 o<- i-esponsi. ^ind <-to'^p i 
Uk K mt 3- nrjs f?pK se-^ mg '^t rb-^sr o* ttcdlUvk rea>r< v ha\ ms: t'^o^<- -i. nx m -^t ann^ 
vs.xadov^ ''^O^ueseats MLUlaj cti giaphs representing kedhi-\ n<,-v>t \ufh tx .0 
oni. ao boss' for no teacher ), workgroup , <daid e^esvuae sharing at rsbu 
segments 

m n Ureisnt^er^bc^bmcat aitiiba*ograips224caodjsf^{, V ptccbrrt$ iaN*caao 

3 t» ^in '»( ibsit u b !bit*c seg«->«it can be djspiajed as a we*..ge m the ctauht 
VI a. 4 M«„ i^nm ^ iv van ?.p3>»sent the number ot feedback leeoxds sn the conibmed »>et 
havme a spacdie attribute. 

mAms 21X 220, 222, and 224 eatt m be considered liters , since thev pros tde 
opttons for tiie fcvte'Rcr to iimtt ti)e number of feedback items m the combined \et to hts ot 
^ her particular chOi<.cj> A autHber of feedback records are thm fdtefed out so that ihsr 
rs-v sewer can VK\% onH those ieesS>ackx«c(MN r \ » h ^ n^-e !^ 

to one mbodtment all sf?gn^eot buttons T'^i . k ttJ ^s. t^e k^aj a cof,tL> 
and uaie fields are jfUnk "^bm the viewing latertace 46 ts fjrsi ae<essed bv a tevtowcr 
This n^ans that all of the feedback record'; acce<;\jbte to the revtewu ajv mcluded m thu bar 
35 giaph displavN oi ^do%s 2''4 ^i^othei embodiment the vsewet s preferences can be 
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j«?ad so when ths -v ewj«£ uuejtats i> Ursi <'cee«SNca, ai J the fkers aso auromaacaUx set t*' 
saved, prefeired settmgs. 

S fsatur~^*ft* \ i^"*"^^ tmcrfacc »H»>vi, a«d ..xiudts n ''2 <nid m <, n^ix^ 

234 D.vp'iiv -e«i226prrfer<jMv dtspia^sfheamuifutoi tcvt^Ki^k "K-^^^^e^ t ih'- u 
the levsewei aad tl>ea pseseats aJI or &oim of tiios? ic sages, ojxe ^ ^ in to- jh<L 
re%ie%er Th© icsxage co te* t displayed m area 226 $& tse^d fe>m tfec nscss ^gt' d<.t < f:\>xtiotj 
ns the teedback reco 174 The meis-^agei* cap d pk^ed in the ft ode thai the 
10 ieamer cnsc ^d tliem (as tex* p ctures, voice, etc > oj whate-i er oowf n oco !s a\'a labV 

Ilo' .Vi^A I "* 5 !n<, u k s k rjs { ,a h<. a 'v fuvi^r Cvj< «5dcx,i U) m<i5n{ ah te she u >.'ab< t.K 
me^s'^gv "C.d ^ivk. iCi n ^■^(^ wnen <;e ec^ed n li billow s-^i: r ^ ^ %v ^ ics 'iOn<;c 
back \ '■'K <,^u^ \}o-^^. n t K'edo^Kk m^<^sarc (1 <^ im ) sk 2 0 e he 
cx'euc? li k ubkk dill c'bii.! ri<- ^ u -^okv ; m s<, « v<M 

IS w\ w <. JTi pi ^^d-^h -i nt^ t <, n i \ N-^ non 2'^~ wl^ c 

\%nl sCiKi dk e%xer V je^pOi^^^e to *he kainer ^n< r uou x^^hes <,vt<,vi \\ J t, ussc 
a pfompt to be dssplayed so that tiie revjewer eas mp»i aataes of other reviewers. Ihe 
reviewer then 'seicct send icm 237 to send a ^specific feedback mmage aad/ot IIk 
s:e\iewcr's re&po«^e to the retiewers who wktc hpsoitio6 Other tcosis. that cm be usei^ 
wbfcb are sot $howa m J<sg«re 16 mdude a storage Jcoi5 whjch cass^cs the feedback 
mess^ige to be vton^d ij* •vpeciftt areajs, tor the reviewers convemence A prompted 
res|x«Rse icon cm also be siiciadcd which causes a menu predcfmed icspos<5e*5 to be 
di^p ti\ed Similar to the prompted feedback wmdovy 150 of Fxguje 6 toj unen The 
5CX can quickly choo&e ^ reply trom the hht tt re«*pnn<!e$ if as appropnate replv 

3 sh0W£i. 

Figure i? hhims viewmg mterface 46 dispJavmg a diffetCBt totiibinvd '-tt 
feedback recojds which the reviewet has. selected usmg the *"Ucr^ ■aI s -> ^ ^ n 
^vmdovti. are updated whec a re\jew6r vhevls, or «rschocks a fevgrn^at oi va*m*ie» u^. 
iotatuR, co-jrest, or iim& hpm oi the comfemsd set In Fieure the re%ie%er has 

dO unchetk-d the "MiggexStion segmem 242 b\ sulectmg s^egment bmicM) 24^ This means 
that tn'^ o\Mi dcs ■«"es that ?11 fceib. ck ixxords ba\mg the ' sufgestjotj" s.egmei3t be 
subiTs^ 1, i fto n U ^. coral med ^et or Teedbavk records "^egmetit bar giaph 242 i<; now 
nVv ^fx v'^->r-'*.cms me amount ot feed xu'^ »^^<.o dNxshiv^ v 'i v lit <, fothc 

cO«^ i L. V iS hv ifvxtx^-c checked tht ''Ut;g<.s m mJ'^!.^ i <^ m h i\cd 

35 "suggssUon" segment does not effect Ehe other segmerits the sitJiaf-on group 228, ^;itice 
those: segment? are. a) ready desedhsng feedhack jXiCord?; that do not have the suggesli<.?Ti 
segmer.t aurihule, flowever, m sharing group 230 and response group J he bsr graph 
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)e 'In <. h . gt d Tat e ndt^vv n ?ir>w ptcvCi't ieeilMv.H. x«vOid<5 ih< r do i ot ht\e ti>e 
^jxcfofe«vi'on nWtc comt'H A$,co dj ;^h, the t?\o s i jeir bar g AphN x ill be tl «. s*UT^e 

'iu> u I i s tKu c r<.s j^e Jo r^oi have i^e ' St ggestson a ibmc -icemetii The 
5 fdtv? wdo\\** th Daj>cm 'h^ cumsntxv-'^c ected combined \ci of K't? iback kvo as, and 
each % md v mun reSect ebe change^ made other %\ adows> 

f'tgore 18 shows another example <*!: rev evter selected s»eumj af txtjog the 
combmed s»el of prese-iled iecdbacW reco ds in view isg interface 46 The rex jex^ei h»j^ 
desebcted <tll attribute seg »ettt& except fa the "^evetyo^e" hmng ai nbuie \e§m« i ^4*, 

10 the ' probletii" s^itoauoa aitr m fe vegmeat "^46 aaU aU ol the respou'?© attr bate seginej i 
Trm jyvie\ver hm aiso ^usiher defined the car5*e^t n come t iado% 2^0 fmi) Ustmg io 
Analog Testing A\ sbowsj e atl biite ii^mdov.& 224 .ill the bar g"5ph'; a c shotitsi 
si-ce ^\ »o o*' \i a og Ttf»»tu ^ \^-ir..c\t,d on ]u d o K>m the 

o^aiJSi * % iixi < ttUtt \) a.n$io<^ »evt ts*" m her r^umK ut oiK'' 

15 n''^"^ o= lest'jii^ The bsr sira*^'*^ o»- i^mn** \vinc"-A* 224 -Msc ♦nit"'* changed. 
L v,nt, Nta nri s a ih;, no ut k ab^ck r o \K rh t xsnn d x d J !. lo the. 
!.v-«r^D Of. i. s'^ f fh i^i, V ico^ V e kvi ricsn) 4lu o 5<.fU, for 

-xano< <los^ a^^i ifh in i k hi ; t i u N recv ris %^(uM be 

iiddeJ to =fh< >,on5bire i \Kn \ ( i^uid^ \\it^ 'hv (.jKsno «!,iuded, 

^ decked $egme^it^ s 50 h^ s 3u«s lu,*. back recoids havnife thos*: nesr n<. nt*- "-t in the 
combmed set The ba i^mphn ot rN.sp'^n'ie grcmp 2^0 are affected tunHot sjqc*. ihey cai> 
onh present feedbaii records having both tht everyone sbarmg segment 244 <ind the 
psxiotem Mtuatjor segment 246 The mph 221 m time wmdow 222 hUv^^ise shows 
much reduced numbvFN of teedbac.k re<.ord^ o\ei tune due to the more-^ecifa jeviewer 

2S preferences Cxraph been ais*omaticallv scaled to i« m ttme v*indo\^ 222 If the 

r % -V,-! «ox^ V chi-ckoiK of i v k d in. N %t example the disaster ^egmem 
"'^^^ hi il *!.JUNf«. >'\iN 5i\m<^ h «n au j>i« e Negment %vii] be added 10 the 

^ Si tl 5. vs^i t^^ed^w£ k t v t i \ arup; > -^u xpCTita 

v> mdov^ -4 tbe stuotnt ot feedback records mcMe those segments. 

1-tgurc 1*> sho^fc second embodiment ot a vievttag intuface 46 wht^h m^lades 
'^ttxtb.ite \vtnd Ton 22^ ^^r£ram?atwnal tr es ?*;0 tu«€' window 222 saved sctti^^^ 252, 
anu rvHo *^(b! \ « s 

^wi^x t l^s^rh ufntan Jh^s K fa 0 U hit x j; ' 

I >.!. ^KkK od ajs ttttibitc xM-^csotA an? '^j n *»fttxJ Kind -v^ U'-fl ^ r . 



graph for each possibk segment that cm be a$sigiied to the attribute. Aa attribute wjindtnv 
thus correspoads to as sttdbute gjowp of Bgure 16, aad the bar graphs of an attribiue 
%vindo'vV .mi preferably ilHsd aiid imBk-d s$ described mth njfeience to FigiiTS .16, Viewer 
irstenace 46' snchidsi^ three 3tr.nb»te wmdows 255 for the tfe-es attribute groups shown in 
5 intertscc 46 axsd also shows addit.50t5iU attribute windows. Status wlndo\\- 256 shows 
feedbsick recor>ds having a.n antn siatQs and havir.g & closed status as deierroincci by Hag 
field 214 of a foedback record 174, Read window/ 258 csbo^v^; let'dhack records ihat bave 
been resd arid not been read by .a'vievver a.s dcierniined b\ fLs^ jieid 213 of fi feedbi'cl: 
fecc:<ril Active ■'AifKlow 260 shows h.-nv many ieedba^k records are ciuTendy in tht 
10 cosuhined se! o? feedback records, i.e. how vtiany feedback r<Jcords ajs "j^edve," Active 
■wisiidow 26CS also sIjovvs how m&ny feedback xvicords arc inacCivc. be. bow maoy records 
are not in {hs c«rc«ntly~soteed combined set If tbe active aad iuactive tjumbers are ^-kkid 
together, the rmdt is the total immber of feedback records avatlabie to be viewed by the 
reviewer- 

i5 In tiK prctcrred cn-sboditviet-t, ihs bar graphs can be selected by the reviewer m 

several ways. For cxasepU;, a -rcvievver eari citeck or uBcheck a segmetu by clicking a first 
button, such a^; a ieit n?oiisc huuan, wlien a poituer is pointing to a bar graph segtnenv 
bytJon 23 r. Ine reviewer cm\ also check one segment a iilter aad unci^eck ali the otber 
segtuenis in that tiber K!ni«Uatx>r.nis,ly by doubk-clicking the .first bntion o?i the desired 
segnK-nr. I'hc s>.'VHn\0( c;;n aUo display the value (i,e, .autriber of recordsi wlra.'h a bar 
graph (or idl bar graphs) represetus by depressii^.g a second button, such as a right movsse 
hmtpn, white pointing to s bm grgpfa. The vaJue could be nsmoved from ti^e scj^en when 
the vSeco«d bimon is released. 

In at^other embodiment, the reviewer eao also preferably display a T.empt!ras7 
25 cornbdicd K-r, for ex8.tT.5pie. as follows. The SHIP1" key on a keyboaxd 5S pressed 
sn-:i.;i{-;!K>< rnr-:\- with a righit mouse btuion to cause a selected segment to be checked si-d sil 
od- .:■ ;moc;i;-. in ihe fdier to be unchecked (similar so the double -click selecdon explajued 
above.!, Tbe tempor^try combmed set of this selection is ealcniated and displayed in the 
view- eg intcrtuce as loag as &e reviewer holds down tbe right mouse button. When the 
30 bMttoa is released, the origiijal combiised set is redisplayed. 

Organ i?.3tional t.a-.e windows 250 are sirt^ilax" to the location and comext windows 
218 ajjd 220 .shown if: Figuje i6- Preferably, a context tree window 262 defines which 
conte,Kt o.r feedback records the reN JCwer v/isijes io be included in tbe combined set. The 
conte.Jtt is displayed hier;nchic;aiy, .usd braricbes .ind s;.i!-'-b:ancbes i;t'atroe can be selected 
.S5 10 further defirie a context ;r.iinilar]y u> the caTegv;-ry fields sl)Owu in window 220 oi" rigiire 
le. For example, a brar^ch headint ~ r;hy;ucs " caii be se.lected, and a list of sob-branci>es 
tsndcr pViysics axe di.splayed. The reviewer can clielc o» ojU' of the ,su!.i-brauches to 
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highlseht the bttx^ch handing Vi»yd ^ d hnui ihe &;idback -ct.o'-dv t » tl e j,o c i e 

ib^ci re^fsrJs jre wjiS^s'^ that h'^asi? ■'g -^od m v cuf^nmset. >s s s i \ ^ <. '^in^ 
K, tjv ! <. V jf 1^ „ % i ^<;^u to ^v, ev,t th(. - lhM\"c<. id i p:^ i <■ m 

io£ n tsc A mi n ' s al^ ^ jj.o\.qcJ s n ; >u k ttcn ^ \n ecd cd 

10 *<}6 208 of a feedback record ca be used io ds |.'kn i e hi h 1 i jus ^ 
or|:ani St at tl e author or re^- sewer ejid Thus, tor eximpk i kcU^ >. )t.x m^xo^ 
coiJTSi. that a cerusn eacber at thored i.an be Yi^v^sd i j e >it,wtf jtjiert* ^.e t>\ se*«s< nng 
<n ofrj^tcbumk-of 'ooauo. to; that i elude t^jc tea<. hot 

Ti. V <.0\ s L k-> <tTJ? ^lf)C*0\% 2?" u fi^U !. f i 

15 ■^-ckii.iC^ 3odi* o il ^ i*- iN r <^ ipb 'S'S -opR e'3' r s atr -^5:3^ o lb tCx.o 

i.3Ui cojri>>ci^i V, \ ul ! *■<, J o\ I \ p^^5 V.!. J'm ^<.nc'C ^K^'udiAdJ on 
cofit ol>- <i.l f V tj-v. fc e-^'.e k-i v,<^ t ! t t M"3x \^ ndow ^ 03 o Tsi t ^p^.-^ oi 
J!o%<.s 'v-'v i:\^e' fo siiS^a i <-f \o u-* cj V h<vh x,> ^ iHt i slrhi ih^n ^ei'^^vk 
K?s.'Oii> Choit^v- 30 o Jri.f dnv,t} ,«eaii mdude "lhi«; 'V^ec\ 'i- aiUi.i3 oia\ 

20 yesffdav , ' van-xih dste range", ^herem "iiais range" allocs s t^t, -c ievi to enter 
a custo 3s»?ed d&h- r. t>gc, , "d '< W\ wbeic n "^V select all d&y<, and thus iU *h ^ kcdback 
records m the osmbmed set, Eesoluuon cosiml 269 allows tim reviewer to specity tise tHiie 
per od re&oluts n of ea^.h bar gmph For cxampJe ? reviewer ca d oo e ' ddiV irom ir^^p 
down me t3 ''6«> a d 'tbi«; week" f om time sp*.ft control 268 Each b^*" ^raph tn t 

2S vvtttdan 2 2' w II tfet)^ fepj^*!eat a number < f feedback items fo one das no t i 
gw'rs ■v^ J, f ^ divpiased .^r he •^An.i O h<,r choirc<; to jt. olui <s v,o' r 1 i*") tnt >3d^ 
weeV 130 3 1" i-SiXCi an >t * \o' i« t. i n «■ m acN ''(jb « d 2tJ*> 
\uxii *hv. com Mj.ea set o fe«<. oack rxvo cs nd CdU^se aitiibute v^mdovt* 211 f ro change 
1 % 's oi bar gsap in aecoidaacc -^ith the a ^oani feedback r^co d<k ti & ^^pecified timt 

30 spaj^. 

lime % jnJovsr vertical scaimg co troh 70 md hon^ostal &calsi g controk 272 
niodtn the at^-p'-^v of gmphs* time wmoovi 222' Vertjcdi scaI^ cotttrols r» dm 
tXii, verti a) ^ale ot 1 3e \vmdo%v so 4s to mcs^ase decrease the displayed height t f the bar 
„ J V ^ 4^ ,f j{ ^ cootrol<; 2'?2 expand or retract th«. hon^osrai t n e «veaie oi 
3S \sico ^22 a-, s .t jsc v^i decsedse the v.titb of bar graphs 266 Horuontd SvroH 
b< r : % Vn ^v'lected < low a a-vjcxver to s»c x>l1 tl^e smje ^^mdow and ^hu'^ move Ac b^ 
c5 vtt s *o »«ce other o^r i^taphi noi i.«rrs,n'K %ms^n m vtmd<?n ^'^"^ 



Saved settings 252 are preferably a nurobex of icon^ or biittoas altowmg the 
reviewer to load or save a dosiresi set of sel«jcii«>«s m the viwmc interface A6\ A siiived 
-i^^rss^gs hp.Uo:: Z'^S ropxesejUN a slaved sei of st-lernoos sixis a? fart:c!i)ijr atiTsbufc scgmesLs 

5 ^r«o« iU.- tn;o'\.ct' r-couVv l\c nv<-h,,x a'-x; Xx <ii^J displ di\ hat grsohs. 

l^iTofe/cteogc x;nvJ s> ta\;^- hs.t'on wdl ,\ave the ojfffui ^okctsoB;^ m ihs viewmg 
mkrf acfi lo dsftk or v'^h. r ~, s>r >k \ ci? tmd gssiga ose of the saved scstjjjg: buttoas to iht^ 
Jet of sclectK5Ti.v as the rc V50vvcr j^pecsHes, 

10 RespossibsMiy area 254 (optional) js preferably «sed So assign specific rcvk-wer 

responssbilif es to specific cotitexts. locatsoas, etc, used by the ksrmng system. In tiK 
described embodiment, organi^ationa! tre«s similar to organiaatiosal trees 250 are displayed 
to specify a responsible person withla the hierarchical orga^t^attnn. A levitnvcr cm 
preiVrably a^^sig?? respotjsibiiities to people "aridcr" him in tcinx:?- of ihe ^^rgtirj/^itsorsal 

IS sta'ctu-'i? For c\i-imple, im adniijuy.iTato; can acoesN spectftc set ^^t record-, undc i 
k>CisU(>n and >x on^e^i 1 t^e n-i<5nagcf : o it; hi\ Jep artmi. n* to K? r>-' f n-i <k> 

fuj >-.pc^.i»iC i,(>!xtex!.^ o; location-, s " "Veo;\!vk -ccoivt' Oac tuethoJ ^"^J - ; ri j>r 
re-,pnru^-sh;hr> n f'( rvo sr oigjs'^s.MJsosvl t;cc soit-cl a ^p.-cjnc mdn'K*t:,i.], sn.i v > u .sv- j 
ditkaTit cooisixt and'or kH;auoti «rgani?atiortal tree fo ajjsj^n context or rej^ponsd^i.ioos \^ 

2D the selected mdividual Oace a pesson is assigned to be responv;blc toi a partscu sublet 
of records, ihe database of feedback records cm be scaaned atid tbs? respos.^ible person 
fieid 206 of those records in the pariicoiar subset is fdied m ^ith the person's name, ID 
Bamfeer. etc, 

25 KXKnvCjs t 'N X mnu i <.diiu J Ux,ai. ^ ^ > \v m ^ se^s 

Si -.i o-u -ii h, s I am \i > is h >ti],hs ^oo Fxcnes ^ v -^dov ^ 

nh to K N ^ ( <n IMslow mF.L e sCf -i, « si ( > <^p< tic* n Ki «.stK « 
pn.s< nt(. v.? in thi. mt \ ri.v\\ vist*" audni^Tn-^Uato iti ii s v us<. ^I^sim \ 

*tCi.h t K UiUv 5* wax sctH 5.tc rcvtewci seiovl < fL,„d a<.k i It x. o I M 

30 to dji>pi*iy the specific tBes^sape toateai from that feedliack record which js stot«d m 
message data portto'^ 17§ ot the record The reviewer cm theti rewsd to the message 
so \6 the t^essage to other sevte^efs etc , as devcnhed wiiit reference to f<tg«fe Ife 
.\lterfijtt\eh, a Fe\ sewer can hdtci a bar graph u'smg a <!ipecjfjc control, tor cxajnple hy 
dmhlQ'^ bck*fsg a right nsoifse bmto**, to display a me&^ase ws«dow presenting a itst ^ 

35 js-cotds {u\xng the velec*ed &egmeat The reviewvjr can then select a i>pcctrtc tecord s 
message contest as described above. 
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\ utu leadings such as *idjag '"S^ caa he tssui *o> oil v funt, jor^ ot v*cv>me 
jsvt t -iv Fv f example a rremi r^r i nUar corro s caa used o i« Oiv r ' Ua'r *hc n ix 
K K Si\ ds v{em^.d 4 r^v c%^c{ iOJJ s spectU t otu ^ nu^na 1 v to ^te'i\ 
-iJ ^s c rJs J \iii|k o ipajtii-uirr riOLK su< a kv.dba..k mod* ^on*nbu^? 

r gu e ^0 &feows a feid embodmeos of \ e% ? ^ -it; ct Ik 
M uai z,atK> 3 ot feedb.3ck i em^^ Vie^ ng mtuh ce 46 simjiar to wv^ m > j i«r*at,e 4<? 
with falter wmdo^s^s o gaaized drfte c ih AttnhnUs ^indov, 224 mcludts & itxhvtfi 
&egmerits that are di placed a ho zoataJ bar graphs 540 wMd lanvuojiai hu to'iN that 
c*»s be ekcted o deselected b> a rev ewer Segment of an anrtec a c organ ^ed 
^citK^IK iore mpic, tfeesegmeit, ofthe % hat' (-? matjoi) attobaie arciov(*a a^; a 
%v?rtMJ g o.5p a buttons 4 s«gme co >dejed selected (che«.icd) when the bit awpl 

un elected (uncKcKadU ti H rm m d li ht l Io- Ibu %h ^^kU a hAi 
gnpn<>^** Art --x i ks n r pM u s a a o' vk^t^Lu h t 

«ilt •> u 1 i Of ^ k « I n ( s ! ^ m ^ tl 

'■i£?ht roiN*. but oru Ksb .m ke\s ets. » akv, p ierdh ^ K pal<,tmx,d ax vk^^tt bed 
With refersfice Eo I*igots 

\i addirior?^* «;egtssc t of ' u»$ele«.ted iSs aKo sfeow iw each of the Attr Dt o 
■^-iv. jru tntcrtacc 4o II v «a ciet ed bar graph 'Ojo'ws ho^v aunv isedbacK record xn the 
<. T o md ->st diu nat haxe a sesrmsrnt <h ^^J fot it «it p£,.m'~ul<<r attjjbntv Ihe "abom 
a*t xbutv Mtv corris<»po'^as *he abo t dinsbae ^« m h$at5>i, mii l^h &bove^ nd 
■frfv^sp a nbt5U' scgnc n t^irft ase I i^- \k u ? $ , feedback atoDute 

J ijrie«db«ATX.^or h uf ^ ^ u ^ i fiaU u! attribute '548 

aima.- <>.tt\t att ih» c "^OO as de vc Ivd ^« a-teR-n c to fiis re ib^ 

Tme \!(? ndov^ „2"* t simJa? to time %vindow 222 hown m Fsgtire 19 Bai 
graphs 266 how the an om t ot ieedb*.c^ record fo eaci umt of time jn *t pcctfied «me 
anj-c 1 ie -^pi^n vO troJ 36g pecihes hetj le pan and aKo show- s paietitlieses ho^^ 
UK i n t o-x s m m h t spm < ^ h^h js also tt t^mi bvs of feedback news sn 
i. ^-^ I 'vi.tW K K "^^ ^ tta Hi >t 'tmx d < T) cat h --a s } »• phs 266 and 1 ow the 
^ f Jii n sr < rt 5 F I ^ Jso d ox i ^ s 3 l - , 

^ I N nink tst 1 Cf t. f sd . * h s 

^ U < f n r n sH X -d i \ *U i Jh si 

^ h \ ^ \ i I t <> i. J t p i n f J ! ^ ;v ?lua a 
nia sp^ shv'- > t mc Ctjch «i u: ^ ai ^ ^ r pH^usi<< n 3 u i. -^o 1 

1 >t " j.hs H n1 '^v s lostesvr otjerbsr^j ■>{<: h h m <. s k -.-su < s 
^ k ht scr>,e bv i lo,- hors^o^fil (.ixdil i2 •? %j{r >o uud^M o t ^ 
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input dsvKC Ti.n& wsadow 22Z aiso be p.ctctMy usea a f itcf b\ sckicttag 
panjtular bar graphs 2^^t' For exampk, a reviewer can ncJccs t%\ o ^xy: g^aph^ represviMing 
the d^ys Jm^y arid Fnda>, which wmM Ut&i the feedback x^o^s so th%i only xccmm 
havmg K date ol 1 uesdav i^r Hidsy ^oidd be mvfuaea tn the combuK»d set 

tecoxd \. m.di U) mt^-.'^afe VviriJm^ 22if cesv-ubed m Figure In 1o %u^i.o%^ ^^ ,i ist of 
feedb«cl (c*, m Jv the &v lectcd combmed set of t&a^ms ss displaced Each kedback 
record s r e ^-A> v displayed a imc of text 558> wte each hne of tot prrterably 
mciudes the date tiie feedback record wa.s created and the attribute segmcm^ ii>=^ie4 k a 
predefmed oixier, that the a4.er seteed t^or did not select) for e^ach aitnbute addaioa, die. 
contsjst IS preferably listed mot shows la wmdo^ 554) i-or cx&mpU, a feedback racord 
bsteU as "9mm. Question. Never/FYI, F-sperts, lJn*;elect€d, Root DiaCcm Sottwai*" 
■vu>ul \ {rd'catc that t^c ^ cdoa k \ ;co < v-re im »>,/20M ard 5baf the user selected 
.jskxnn of^M i Uit ^ \-vheji>;'" attjihute, TAperts" fdr 

who" aunbuie, atid did aoi &elett ^rt aiinhiiue tor the about" attfiburo, Fmally, the 
feedbasik reeonl ims a context of "RooK PiaC<>m Software." 

Window 556 displays the com&m of a feedback ixscord selected m xsmdow 554. 
For example, text Ime record 560 has been selected by the revjewer by double c 
mouse btmon Text hue record 560 htghltghted, an< 

coatext of record SesO are dis^played In md% 562 of wmdow 556, The message contest 
564, if any, of the highlighted record SisO is displayed as text m wmdow 556 Message 
cofiteat 564 ca» also be presented as audio mformation, gmphicai mformattcn, ar in 
r form the tiserirspui the stissj>age and which the a^viewe. \ scfcs > lo a.<.q * 

U ccmtext Windows 250' can be selected to be dtspiayed over the 
e area of a dtsplav &cree«. The reviewer may furtber filter the ieedback records in tlie 
1 set by selectmg a context in 4 biei^chical tree Context wmdow 566 3& uved to 
snow the hserarchisal structure 0f contexts from whtcb the r 
von%\i c*itcgoiy i«5 «:bown as a "toldcr with the number of i 

For example, as shown m Fijpr© 30, 55 feedback records have the 
Of those 55 feedback records, 32 hay© the coutext 

i mm, 

Comeji.i vunao^^ "^uS $h 'v, - thy context subcategories within a se.ec .\ . ^ ol 
wmdo^^ S«36 \ ^.v^^D-y djspia\c<.^ a^^ a "folder" icon indicates that stib <. . <.\ \>cs o\ st 
35 w 5thm that caiegorj', whde a (..iiegorv dissplaved a*, a document <5bcet ha!> no fswhearegones. 
Ti\u«», as 4,howB in ^-igmc \vwd»-^w 168 <ihv*\%& ti^c iubcatcgoues of die highlighted 




'IcotJ Menu«j csttegorv of %vis>dov' ^66 Thesv' vyKak-j-.-^s raKjde as other kon 
Menus vubcatepon , 8 wh'^traent subea*ep;on.', i 'nhcii t onu sutK^ieson f^cb 
ubCsittju* ^^v X 1 wiTKlm '^f^S aKo shovtj, Lx x ^ nhsi ^ U\. lb >.'» tco x3s hA\>.ns. tliat 
:>ubcatvj.ui \ »exvt;j rxij-v **'lJiirth-coni0jnc Kct 0 sc^-iulsh s \ v tug a si bcaiegosj 

combutJdsc* Kicwmpl^ v.u NuKa>,>^o- ^ (> i icliteJ mdj^atmg hat onlv 
ru:.oMs h&vmg < ontv^xt %tj "ssha* an, pa vni% ir tl v ni>med hsi 

4ddjtJOBal luactioajs ca bs implemented by viewmg »meiface 46 One ^uch 
tmctmn mc!ud«?& add tonal filters to fnnhe cois^straia ths teedback ecord<» m she combiaoc 
10 s,e aa,o dii5g to rex \tw^ {ircferesKes Oiie such fsKer k described beiow wjth eterencc to 
J*3g«ie 32. A differsat ftjsctjoa cm mel«de reviewer chjinges to ihe vrewijig jatsstace 46 
aisd the feedback interface 42 For cxaispk* d m% lewer cm preterablv ehasae he at&ibuie 
n an1 it^nbuw -vf cmcnt n\ n<.s On,, w « k> lo fi's k <i>v^v^ y^iih re^twrcv to 

feedlsajk it5tcrf.k^t- 4? fif a rc«;p!->n,^?' tv^ usc^ ^ ^eed'^aok k> sr^ipi^vo feedback si>\^tem or 
s prelVrencc nt m<.' reviewer. Fur exajuple, tx menu ^53 crsn s^5lected %vhich could 
display a scmetj of icou? as th«y currentiy appear. Thi? ic\iesvcr could ?ek^^t r; dUY^reut 
icon or could dravi' a nfw scon, and (be changed icon could then be saved in stoxage block 
44 m that the ncv> icoi;^ v\ vjuld appear m a feedback ititetface 42 accessed by a user, A 
reviewer casfi also proferablv m<5ke changes lo ihe prompted feedback items 12 1 and 123 aji 
shown xa Flgute 6 to dkplay new ar addMonal items or t&mov& some item« from the item 
lisL These changes would again be stored m storage block 44 asd appear in ever>' 
feaJback iTJterface 42 accessed by a «j;er, Sucb editing aad 3mnipu1atioa of graphical 
2S symbols (such as icons) m4 retrieval of these symbols from a database is well knows 
those skilled in the art. 

Othn- general feakncs cm aho be iiJipSerneniea xn the vt(nvt!tg n^kuface v<hvch j^U< m 
a revk^xver or author to ct^ate material or issfortnation that i$ available to users of a ioarrung 
envitonraent or other conjputer eaviroameat impietnenting the feedback s?ystcir> Su>.-h tm 
^ anthonng aysretj^ can be iacorpccated witMa the viewing imerfaee so that the cjxsation of 
sncb infoHnatioa is fully coaipiemersted and suppon? d by feedback information, 

Anothci aJdrional tuu. u. :s urr ^ ; i^kyr.cjsted jir; vunx^n;; jntctiac.^ 42 

jTjiclude.> ri.-v!osxor ..^ccs:?s t^i «r ?\<Kr oo .^vw; « u^er \vjr;ch sc-"? a feedback kcm, bVsr 
o'<,impk', a 50viov,ci can „\,aaii;k . r«;.u.^;.r k'sdbac^-' rirccUi-'C iX-cord v\h'ch sra?f'5 
x"? that u. partivbiar symbo; m a »cnematK% soch as aij OR !;;ate, is cn>.ie xr 'Tho coxstoxt of the 
ii-«>r wh-f \cnt the feedback is already stated by categorx' n;ir^ir-s j\ o<3r.teAt sx uhh^w ;.'^"> or 
250' of ^tewmc inteiface 46' or 46", for example, as "Apphcation progf.ira& du^xH^s^ 



pu serried vitb ^ button O f v.kc ed ould piv3\ the jvs .^.v^e" % h * nort dt' 
d8i>a'p ^ f I L onisw ex^ fi 'he rx.i^t ute\t useU ji the co t^xt e m pk' tts s 1 n s 
compi '^t ■'I i I )i l^NchviTitv the sreMewcr coiUd \(.k'tt *h 

S b tun \ chLtuk iaur^h t*5t i;.n-^l i.hcJ u psx>^r n »n I docl i feut r pr s i *iie 
R-^j % ^^5S^ '^ukt fiboi ^nJ «p ihc uj o pro.,n uhah vi. k ib 

'i>Ut trap 1 5 iv- c \ Q\K^s \ i i o i i I 

i. Ih "iv < N I i h i hi. I n f r r dit^ ■> i \ ^ i-^ 5 i n r 
10 i- « b < r i Ci. r fj It )i u it\i ^ t. o c\t \\ a, 

I M \K } ik tci miii ui^-^>^ti t in hi. lie Si i r n I rsn 
feedback Item hm- ?5tf )S seu^n^ ihe ex ku -^n [ o mm r k i 
a<< cnbcd abo\e 7J \ oi Ht. b^mfjci i ot ptsslk to -,<m t fv.-> -^t 
jBessageSs such ^ a eamplaiftt about smpioyee benefits- lor exajxiple. 

is Ti^a -e ^ s^ovi-N ^ N<p^'a e nmbute iist vcjeca '>71 of \ ^wh" vt \i Xx.^t <. n 

t>c u-seu o<. tim^n* n of 5 \ tn^ tis. interface 46 \ho\\n m h 
^5C ■^n'tA al ot h^. «\ yj b c amib«tt.\ vsfbiv j n H>i&^k l\ t ht, 

t vlVvK ^n'l sUt<.t o m the % cvtina t n x \ m \i. 

typjca'K', iicrs are n>snv moa" actnbuie*; lor ieed^^ii-; *' n^cotx^ th'Ui can bi: aihc^enVv and 

M tc<ihs5v\ 'H pK•'^v^tcJ 3n sh« xjCA.-nr Dv^tia -o uKun aa'^\-^Uv„<- i?c^ rot >'~<*'ix o r" the 
vje-^mg vnsTis.ce <:6, ior cxamflc. m the vjewmg mtcrtace 46' Fsi^jiic -0, ine 
Attribmes are shown in attrlbtJte wiado%'S' 224", These five attribuit;^ can Iv .H^^auk 
anribateji which ase pfeseuted m the mmn viewinp interface 46 and ma\ ooh, ^ tull 
^ cation < f the to5*ii aitnbmos th<Jt aie assigned to >i feedback -os ard 

2S this f niboa mi-^n', a 'evtewct cati ^ te^v ao(.^JK->n J <m i ?>< i\ - o'^ s^l ^.i^ c ^ 57 ^asJ 

^.■anal^ofs" cmjK .-.dc>r><'bo att / ."es S^U^i. pr,, -civcl a il iUvn \>r,Of»> !i o^ i;H> 

<;cjct.i 5 "4 usiru to. v wujpit a r t;nu sole, jon t'osr. liKuu uenis 2- ^T ff^bv^" 'v-^v*, "-if 
3r:ler^dce cxmtrt^l ttrsbute h«;t saocn 514 ii> the \ liis^plaved, ^hc%v{^1^< .ojuo <!; .iH o\ i .t 
30 attributes ^nd the attnbtitc segments which cm be -fesigned to a feedback record in ti^e 
feedback systcnL In tht described embt>dimeiit, each attribute is displayed in an -attribute 
bfi\ ST7, This list of attrtbuies can vary f om osc feedback sy«t«m to another dcpessdi'^g 
on the 3trt sburcs dc nx'd b> thf ff'vievi.ei s and mtra, in a psLrtkiit^r oystm 

e.nbodri^ent, f^te.V-'eJ at! \ e^ c i >"'*^uVs v s <i'c ctsovTSt \ seicx ted to 
dispSa^rrt ,>n the ma^n Mcv^'t^g ses>sen 46) are *S(t5 ktrd to d s,t3ngu«sh th. m troiu o^Uct * r,o- 
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preferred" attribntes which are aoi displayed ki imerface 46. For exiutipk, ih« tjfe 579 of 
the pTsferred attribittes 578 are shows m mverse:, xvhsle the titles 580 of the non-prefemjd 
audbutes am displayed as blick letters. The non-preferred attdbtues m the example of 
Figajv jn;:;iKle te.chriical altiibutes 512, organizatioaal attribute's 514, petsonal aitributes 
5 16, and other auribur.es of siaaiflcance to the reviewer. For exs.mple. in Figure 31. s user 
age atnibute 5S0 k a persona; ^uribute 516 that describes the u.ser.s age, r^rd u.ser region 
atr.r?bi5i? 5S2 i^, a per.sonal htuibute which descnbc> the rshx.^sc.ai x^^gsoa -iAhid. the user 
was situated when he or she snrcred teedback. S:; i;iuca.I aUributeN 5r.; such jt5 

applicatior* prograiXs anribute .584 can be snciudcii in il-,: -uruiuse h^;T to j-srovidc !afi5rT;!ation 
on wblc.fj ;!ppliCfj-ion program ube user ->.vas using jtKt pdo? t!.> ejiit-rsng tccdbacK-. 
Likesvisc, orgiuuzationa! attribtue.v 514 such «s job atuibute 586 (d&scxibing tlsc user s job) 
can be provided. Other attributes caa be used to provide litforraatjosj about a oarucular 
aspect of users* feedback; for exampte, feedback system attribute 58S provides information 
OS bow matjy feedback sscords were coijcsmed with aspects of the feedback interface and 
system. Addtttons] attribtstes 590 caa preferably be scrolled onto the screen or displayed 
onattnbute list screen 574 in place of the other attributes shown in Figure 

.4ttribok^s disph^yed in hy, screen 574 rcc^ preferably sh<mT! sin:di;uiy to ihe 
attribute's displayed in viewing inscrface -h> in Figiuo ;< ? , Si^cy are dsspi;;y?d l5ori^O£«ai 
bar grapi^s siaular to tlte ataibutes of viewing imerface 46" of Figure .^0. Filled idarfc) bar 
graphs show the attribute segments ibat are curreatiy selected, ai^d unfilled bar graphs 
show the attribute ssgmesits that sre ctinently deselected. Preferably, ossly those attributes 
selected to be displayed oa the main viewisg laterface screes 46 ess have deselected 
attribute sepnents. i.©., all attribme segments of aosi~pief&m:d attributes astj selected, 

Th^; oon-preterrsd rittributes m&y be of pmicular significance to a revie%ver, who 
may desire ro replace some or a)i of the currently preferred atinbutcs "vVish cisneritly non- 
preferred attributes on the j^i.^in vicvrjng iatcrface 46, For example, dii,- revi-swer may 
decide to replace the "about" artsii-tuie dis^tia} ed sn jme tf'wv 4^ ^wit tK n^" .ig< " a^Usbu.t; 
To select an attribute to be displayed on the m&itJ viewing nnerface scieen 4x5 n.e. from 
non -prefexted to prefenred), several possible methods cati be eiBpioyed. For exansple, a 
reviewer can deselect a pMe«ed attribute 578 by poiatirtg to the tide 579 or an atiribute 
segmeat of the attribute 578, which cm "uahighlight" tiiat attribute 578 (display ths 
attribute, box 577 m a different color, etc.) The user caa then select a aoa~preterred 
attribute In a similar way. This would cause the preferred attribute to become non- 
prefencd. a.nd vice ver.sa. ThR previously aoa-prefstrsd, rJOW-prefefred attribute could be 
dispkived in the s.oine aica an viewing iuterface 46 which the attribute it replaced was 
displayed. Other method.s can also be used to deselect and replace an attribute with a 
different attribute, in addition, aa attribute can be deselected (rt^ade non-piefem?4) and aot 



46 whcm the deseiecsed aUdbote was osce dts^lavecO- 

5 5 J x% nagi I iish wi^i^ •^c s i >. \ n f ; <• !.->p|, „ cis n ^t. n 

md segmcutis otf the main scteeft The reviewer c« preforabH s^ha m-> ih i\ i 
seprteKts to be AspkvcsJ is vie\>mg mtortace 4d The sdectioji tan be ac^ cmpH^bv s' ^ns 
ex*impj!e hy seJectsaa tije segment words ^Ql ta displav that segmem m a riel^nvvi 
ID >,egment {ds'^pLij ths «>€gment ^Oids. as mversc, etc Ssjgment^ that mvim,ci docs «o* 
wjsh i« be displayed car be de'yignsted n<m pretefred h\ dicUng on segits^nt %\cr*,is ^9l a 
<5ewond time so that the woid^ are highlighted m a ditiesrent color e\anisk \ anou^ 
ofeeriTv-t 50'^<; < -u? u&ed to <.elevt pimcu^ai s^'gni>?-^tv. is pM«ra%^ o x on p ita td 

re-vi^sv^r s>:lo^t an .itJ^-Jburc oox ^"^ ior tdnmg h\ thckir^ %vai -i du**. t nr m>*u'5<; 
button, etc The attnbu*e name can thea be edsted or the psstjccJar attrjihutv- scgmcat xrai 
cati then be edited or changed A reviewer could evea itmov& &ome segmeMs xfo'n an 
sttnfeute la tl^e editttig pstocess. M some eitiksdsmejtts, the changes that the i«mwsr makes 
3D to the attributes and ^cgmests can be sa\ed la storage Mock 4 !| tt5 tlie fcedb-jck s\ ^m-n 40 
aadcai^hepresemeiUousexMH feedHat.k wjertivi? +2 $til- i \ \ j d(,v e& 

Ttsme 2 a vrtrcsi v„ sp ^\ of an v.\ \- o u i t il iilkr a i 555 

sekaso-^ I '^hv.nvr nuK e\m fk o^^igm^. 32 jt^ Kekr.h s ajs-! i^ a ^ 

Svi ^mpi \patsal d{i^ar«n A map ^V^* of the I mtcd State<» is At % ' nLa.nf 

jx^^ojs «c dsxjdcd b\ dite'-em colon f^rshadiaji Arevie-wer^as s.t.kcca*h Nu3h% 
jCyoB oOO anmg a po»ntvt arrow o02, cau&mg a '^ee.osd %jndow s^04 to oe dj<>played 
^ Wiskfenv 604 p«t;terafel> shoves, the selected region 600 m greatej detad and ith different 
N« tfN \\«hjR the region di-sJtngin^^hed bv &hade ur coloi The diffeieni t,olor<j can inforo? 
tlx reMev^er ab^^j jntormatiofl keved m a legend thn information can. for exaxn£>le be 
r ate- d Jo tht. r*- iv-v^^rs O'v, jm^at on o'- ^'vteromi"; T "^tfui Ic ol f „ i * ^ h 

35 Oth^,! nuomatjon scHt^d to tsu-clback ^?nys^*)ep3-e*-en£.dmwsT^(iovv 60-*o''v*{" -^9^ 
For e^atnpte, a nnmber cas be .bHpla%c'd m each i,cate or scgiOfi mdjc^tiaa tiit, number of 
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feedback ecofi^s i.h o tgma^sa Srom fhos.e sutler or regions '\ \ini Ut number 
mdscatma: th& a«mber n.'^ t tn the JecJ'>ack ^^-v ^iccp c^in .also be ^ks^^Aved 

A rev ewe c<i ^ ^ s n-^cmcu '■vct.bdv.k -t ^ Is * ^ v' ^uj 

5 t - r\ xt ^^<.i ^£<^^£ h'\ ha ? Ik-'-i ks Jsuck u orK e ? s D i^- « ^et 

fiiter the feedback to |v u_uk ss ( ^ M^r-- sn \unv1ox% otM Uie"iat 

selecUng a &tate can cause a thiu xnu <- u uv ai^n'a'v d la v Mdi txi^i uit^s > 1 1 lat sr ^ ^. 
shown A j^YieiAer coaJd the s«k a cii^ i< > a' Ser the feedb.'eK reeofds co that cj^v , and 

10 oa Other formatsoa cat al&o K '^..ivv. J in jscteea 5% and mdow 604, <5ik h cmc^ 
b« laesse-i i>chools etc , and a numbe ot teedback m^ords nnpiiatiiig tsoi \ t! oj^ area 
"Hie reviewer v>oi Id tija& have ati dea ofhfm mmh the eoti bmed bet vvouk' be a^auced tJ < 
part culaf area were neisn. sd In othe en bodiments., diffe e t types ot |iecsgraph$c t r 
spatiaj areas Ct n 3i«;o he pfes>eated as a f Itar Fo exae p]e> a school campus o eon pan^ 

IS bmldisg cm be showss, aijd a J5ef\ seue- ^an ^el«?ct f on wh ch sixsav otiiqes or buddings 
fee or she wjshes to feedback aisd tUter the mmbMed set 

Fjte cree 5% is just one example add« onal filters t r other \ uahmo i aids 
that can be implemeated m coniunction wtth mw.mg mtertace 46. For exampfe. other 
types of graphical p esentattoss or simukttons can be displayed vs^hen requested bv a 
m ev ewr, Spa^tSe fdteis such as ftUer creen 596 caa preferably designed asAo 
«i5piej leiited bv ope ators of vie'wtng t tertace 46 o the reviewers usmg the ^vstem Such 
filterv cast he made avaslabfe m vte^'i )g astesface 46 and custo iMEt'd for a particular «56t of 
<''t -'^s ^ sr exatiple the alter screen 5% might onlv be a\a lable to a n-Men jf a 
ni \ livs n Vmti,^ States.* \s seWt;.\l >^ coate t vimdi w ?ft8 of vjcw uj* tntcsxtacv 
25 4t Otner idter caa be i>ah ava iabie tor parttcular co texts time raages, ph^NKal 
locations 3e%ver access ievc», or lor other select o $ made m rmv^mg interface 46 

l-jgnre 20 v a flow diagram ot a n ethod "^sJO ot ixum& L iiK.d-j.K k s <=;u u <i tlx 
prese « mventton tor the toUection of teedbacfc The method stars nas^i 4xii ma 
&tep2$4 a user o leame ttavigates through a uompntssr emimx ment, vuch as* a learmtig 
vn^trcnmem ot othei <.ot v^am eavrrr^nment StJCh an eavironn^ent fot exampie caa be 
n i kt e'^ s. i V, -I c I o-?n'Jer s\ «itcri as sh jws. m Figure t *\ tearamg envirtinnsetJt caa be 
n J , 1 Ot, I' at„ s .t, uiK! trt^-Lk^. ■'j* as sbo^^j^ r Tm^rs U a k-attief tfite face 130 <ls 
Siov^a n ^ «jhe o oUK'r aitable s = ert rc na\j j.('n ^ omp »r 

en tronnvm t s k va th« t^e user is fos v-xampk usm^ m p^r > . sv<,^n sa 
35 applea*>0)E iwgtair. vonlroHn '^en.phcr^d acsacs si. ^ iLs a^ o 

peitOHiiias :sjher i.'^tn tsvs %hsh nrke ts' ^ i<.or ! s < j > t,cs i t'- > \u 
tofjc ! tr*p^«n.' tv-c b\. example the kPU 12 ut tiK cva.;»kj s^<;i m pvr«;5<i>h 
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checks to daermine xvhethcr rbe u.sei has selected to inpm fssedback by checking t!>o 
feedback icon of the learner mterface. such as iCi>a i>2 of Figure 3a. icua m of Figaro 8^ 
Of icon 173 of Hgure 1 4a, If jhc Icon has nol beeii ^etecrcd, the p^x^ess loops back to step 
284, its wMdi the user commues to navigate the computcx emironmenu U many cotnpui^r 
5 envjroi3metU&. a computer s^ystem caa chesit for a f&edback a^teioa coacwemly while 



1 is step 2B6, ths fiooej^^ oorunnc-^ to ^fcp 288, in 
which a feedback isterlace window or dialog box displayed ob ^icroen 2 i Suitable 
feedback interface windows include feedback interface 42 of Figure 4 aitd feedback 
mlerface 1 54 of Figure 9. If leamiag ititerfa*;e 130 is bdag used, the logic first checks for 
additional user input defiumg the context of the feedback, such as a word, ico«, etc., 
before dispiayitsg feedback interface window 154 of Figui* 9. Of course, feedback 
mterfaeo controls can be displayed without displaying a wmdow ot dialog box, or ™ 

at to a microphone; stich an 

lo step 2m a feedback recoil Is tnttiaiis^ed, },e., a record data stru. t>i!c js .^n^scAwd 
in mensorj' for the user. In step 29U technical attributes are pnsferabh jr^sencvi u>to the 
created feedback record. These technical auributes are nrcrcr,-(M> $>Mem discemabk 
D ajtrlbmes as described with reference to Figure 2S and cai quK kly ana KutomaticaOy be 
Inserted by the feedback system iiito the record, The process of inserting technical 
aaribuics into the feedback record is described irt gs«ater d&iml with respect to Figisre 33. 
Oiher aunhutes which preferably can be inserted into the a-cord qwickly or which are 
aecev?!ir\ to Jetcm^ne the 3ppearaj)ce and functionahty of the feedback interface can aKo 
25 bs irsenea at thjs rtr.u^ Nt->L m s.tep 2^2, the usrr?; in the feedback interface is 
pwc^i^ea and fi^e teeJback r5L.t.orirs rcmannng f^oluf, .Uv m accordingly. TMs step is 

5 2L 



In the next step 294, the logic checks if send icon 92 or 151 ims. bct-n .sekaed by 
rhe user. If the send icon has been selected, step 295 is implemented, in which the 

a) feedback system looks up the orgasizaiioaal md personal attributes for the user who $ent 
the tccdtjack message, as described in Figure 28, and automatically insert^s thcjjc attributes 
auo she jVedback record. These are fields that are not detjendent on the specirjc 
. h,j{c-! icsjasc? the uj^erV feedback and can he a»tomaUc;d1> e-stejcd in (he re. 
CKJunpk, rn (h-s CPl 12 or other proa"?sor ot the fee vjba<J, svvse;^ Howrxoi, ihi.-i 

3S -nlorn5,ri<v5 -ray uk.^ s>-'UV tirne tu reinese dnd ^rc -.■,'>-n thus isj'ier.ed tb,.- kno; 
snic-3nc feeJK'it'k i^kt the user ka$ <:\\kC. 'la- tevilhaok jfnoEta>.T 'lD5 pioct-ps is 
a^-?,.r;oeJ m ga-ater detitil v<ith s\;ferxincs to Fxguw 34. .Step 2% is ihen mjuatrd, m \\:vxh 



so 



ih? Bllcd ieedb<iok fxj^om ?s mp$« fro.o the as^A >,«>nj.xHt' ot conipiiter envjronmom lo 
the s»torage block 44 sho\v« 3« Fx|jure 2, whjch fjt-toiablv mcUidos a nstaDase oi 
feedback records In embodime the feedback reoorrts mav ' c^eaa..d up <\i%&r 
thev are mtpni ¥o^ example, ixs krgs f**«db<^cV s%si$i»m, spetitic author fields 204 .j,s 
sh^^^^^ sn I se^i' ^ sr v V <H fumancdC^ fiCed m the rcconJ before it is, smred m thi? 
J< rab '-if JcNjs. J bt? ti.Tit? isie u^»er ^snf & k'edb*ick mav also tjo^it be s*ojf«d xn ih$ 

^eet'-w^k o" Ih'-^s'^-fo i'^'U ^ c na\ h i ^ tb ^ ronp^HOJ cm^ro menn-- n op 

to<i JiUvk JttvOrJ at^d n ^ pr.}Ci-SN wps Dack hi whx^ .i - i t x n v\ to < < s .f,4 v 

the computer envuonment If the feedback \u>n tso' seicc si s5v i „ - pr > ^ 

loops b&ck to su?p 2^2, m which my comimng mpui\ to u>i^f TiC\ t tettace ajc 
process^ a»d the feedback record Meda|!|>?ttpmtsly. 

Hpwc <ja%w ilagrarnilasrtKJ*!^'' «tcp or hgUTc 20 sr 'SrtL'rh tochnscal 
a'Uil uk dttt m-e i,im<i he feedhat. recoj i that lu^. oeen tn^ u Ha i I he >\(\ bfcgjoj^ 
<ii 0 J an<' tr!stcp6M !»<. o set fsna < ^I'T^ajiMi i* ri'\ ivLsifved ^.ron Jre 

apfl jor prcg-am an ' !s uMiu I nio hv .k *cco d Tie ooerUtrm ^orte^t 

jna^ntiatton includej* ..u^y uucisatjon pas^^ U > n co-'^.h re'- e' % >nm''n h-it rK^ 
user navig^U'ig to the feedback syswxn t-oatmlk- Tbi^ ih orr > -^Uov' 'in 

kvdbttck H>'»te'Ti qmckJy t\l\ m the teclmical ataibuves ^xpkmc<? Ix^low. Foj ex^ mpk- 
a us^r was -working in & work proeessiijg apphc^tlos program on at certain documcint befoi^ 
a<. Cv sv^ng the feedback mterfec© -t2, the %vonl processor cmM pass th» feedback system the 
aafne ol .he -^onl processor, the vmjoa of t!w Viord pracesw. thsf document the user wa-. 
^ o-s.ing on tbv page number, etc Some or ail of the desired rechnical aitnbmc^ c^n be 
obn-* * e J m thxh itcp Tlie apphcatlos progratn caa pass the operatmg context mformauoR 
a& lu- example, otse more numbcf? whtch cm indkmi. to the feedhack system that a 
p^mikr apphcarton i c t, n cpc ati ^vsltm ef<L v^as bcru used -^m rj\ 1 n\ < I 
atmb\stos iotno vd iii £ v J h..''.r jji be jciifsese i in ph* \kp o-TOif^s ;o 
dvsv- oed h'>^o'v^ In oin<.r sc^jo e s onvns/. H 'n w *ii4 4iid f>«rHona! 

<. t 'bi!k -U^ * ^ asot tr K tttskv^l ope-ilu f< .tvXv. . n n-iation, fctmilat to 
Jc cTsbe aK%e i«sts;ad oi bemg t«*ne\e>l m \ti.p 295 cf I jgure 20 

In step*. thwgh «j2S, bpeciSc tcchmcal attributes afe rehicved aad ui3,en&! mto 
the tecdUck recoid M some cases, ail of these atlnbutes mil not be avajlablo and only 
the attrsOBtes apphc<-bie to a panicisiar coniputer sy^stem need be retiieved For example, d 
nc» d^^abase program iff being jmoiemented oa the comptstej sivslem, step 624 cm be 
slciDpei la »e\t s»tef ol^. the netvtork cha;actuistscs of th" s%stem imeletsKmmg the 



feedback witerfac<;43 aai rctnvAccl ^"ct tbc ; mo-k i\pe m.4 newotk 4ddi<j?ss 3i-e jsttjred r 
tht. feedback Network chatacier5?,tics mc^mc the network operating sv\tem npe 

^\endor, con pmy, etc and set^oik iy&tem versioa), th*. tim^^ik sadjes-si of the user, and 
am otfeer mtormat^on c<mcenstng he network cotjtiectiBg the compt3t«rr ctJvifOBtne-it 
5 i.MK' i-OT^w fct\ Ih s n>*Offp,-«rt»ij iS typ call> avajkhk* t » oAcrf og^cjtus *hc *ccJ Wck 
oVs'cifn ihtcogo tht network operadstg s'vsti.'Ti In su-f 018. ihe hatxtw!:.-i« ol^-^^u-m 
ch<;'-..LteEisD<.s .ao re nev^^d and tn$£>Eled «uo thtr &cdb*ick recoul ji srdv <*-^ uns. X'ssn** s 
ai^Iudt' the Kj|jJoc«^soi tv^v, S|.)ead, arid fu«cU«nahty. othe. s rv- <. o-p^^->,. t. ^-ors, 
<,k rv,«mo.TO^ o{fv4\t<vs, liable ori the compmois\Me:Tj,a^5o<'vre5H->bc <!]si o<.fOf 
XO to U50 coTupvi c! ^vs^tciu HUui-s <is d.spki. ad.'ptsrN vor.'j.'iT' e>.\ oJv .j- I'OviUd- tr.v 
All tiie?.i^ h2LaKv<jf5; fl<it%rm ctoactet istics ate pfererabi> «weued srto the ffedhrfck ?^>am^ 

Is ocxt step 620, the operatsisg system name and version s^trieved msejted 
imo Ihe feedback record. Sach tofonnatioft is typically readily available a eompmer 
system. In siep 622, the custem apphdadon progrjsm md veisioa is mtneved md inserted 

is inm the record The "ctsireat" sppiication pfogr^ is the appiicstion on-^erair. most teccmly 
nsed by the o&e^ before acces,&i«g feedback iaterfacc 47 The cmicnt dp\<xi. pxo^fSxm 
r.Av h& rintm^: sn th.* backv^oot^d" (coacrfresri% } btdm>d ti^c teeuhaok ?rtsr*^i3,.e i'^ \t>r£'e 
nU! ,! lO)-^^ i,5i55op!'2- t>xM\pc £U'.v i'u 1 .os,auoT) o.-ihe datab<5^c cuxicnfly beu;g UNO- 
by the usc\ <rt. ^t. Ub'-XvV <. n.l mH^'-'o*! 'nto rl ^ .ccdhui^k -^tccrd Mr^'\irK to tnc rcfv^o^\ arc 

M at>pik3iU(riprf>srirT^a..rav<.n'-.K-i.'<.^r5K> .h<\c l3iNiep6ii> itv ra-'ne c;rd \x aUor oi 
the docuGiem access-scd by the n&ct 'Jxn e^,aj»p1e, m a %vord proccN^-or ot sprcadshee* 
prognmj) is letricved and inserted into the record. The temi "document" ean refer to any 
type of data life; sjssd in appilcation pro-am. The document tmm cm be a filename, 
and the locatiou can be the place or hierarchy wh^isre the document is stored <a disk d3r«ctor> 

2S stn3ct«re, a disk dnvc, memory address, etc.) In step the locatjot) m the doeumest 
wheje the feedback was itsitlated is mrieved and inserted into the teedback record. This is 
the <!reeift»' location iti the dtscumest ^hete the user wa$ ssjtiiatsd just pnor to acccsstsg die 
k'odbuck imer.^jv 42 This location can be specified as a page nt!xab«.r, paragraph immher, 
:m? v.i-nt-er a^i nuntter ^a& m & '^readshecl), spatlaJ coordixjates, etc., or a contbrnatjon 

3f) of sonifi or ail ot these. 

In ^\-f 6 V,), ;ht? version of the feedback record fonnat is retrieved and mserted into 
the feedback tecotd. The vcrMon is preferably Indicated as a number or code. The format 
of feedback n?cordN otay change over titne 4S fcatoixis are changed m the feedback sysujm 
axid different types ajid amounts of data are Sstored In the feedback record. The vetstou 
3S namher or code of the current record format iS mserted into the record so that other 
application psogran>>> sucJS^ as the %icv^'lag interface 46, can dacrmsne the reeotd's, verstoti 
The apphcatioTj pjogram can determirj^e how tssany fields are In the avoid, how large each 



wmmvn 



S2 



ii&lc s wba* t\po j«< htoxt-Jt m Si-vh nc-\ I oJ hs record etc *'5 i^vta stored 

mfomtatioo conclautss; d^tts> ok nmrNr with a avOjd ionnai aw rmss coi'ecd\ frnd t a a 
m the recofit at,*, ording to thd* fomnt The 'jjoi.evs 5s djen coaip^cte HKlicaiert m s>tcp 
632. 

5 1 ''I 'lis n ^ -Ji ^dml""! Ui ^t! ins H 3 s utr'TiTii ml 1 r-t. c ^ 

if the ori M 1 1 Mc tcedback mtai^ce hu*- te£ s, m-^ i Fos <, \<i.^t ih the user can ^^cbct 
djf&.rt«u<3 rjvsiacojiiex fidds ot fa dbai.K mtvit*it,t; 4 J Unsvaoo>.c«rwh^£ me 
u«jsr desires the te<s<!baek to descnbe tlie coaiext of & product pmccss stmcc or ts'.ue 

iO whics isot a«tomatK£U% known and <5jk.vifiecl &om the user^ comext m the to»t}p«tei 
emm>nmem or from default s,ettiag& ff the coetexJ sot chasged by the ns>et, then the 
last k»0WR user coatexi, detduk contm or so co«tes;t ai all }& used m tfee feedback 
smerfaee, a^d the process cotitmues to step If tiie context is chatiiged, ihe fe«(ib<%vk 
interface js chajigc-d acctrdmg to the tJser cliaagtss m 'step '^0*^ Thts step can mcludc 

15 ch^^m^ tK ^^t>pe^r3ria , min^ber ^d'-*j finv.uon o^jcton n(< -^^cn^^s n <mvj ^^iinbute 
tcon^ sfK>vii3 1 Hgy t 4 i^ioraftecj Red) < cn s Fl u.>d 2 s a Fuur.. a-^d ether 

v^ia U an '-'^ rr ^ c i ns n jUt (O *ht ^Nv. h*, (h s I ot d\ 
^va5»nb1* ct'^ t^fr^fnb"- ♦h*- {""C-'^'-a'it" -I -—ri— snt-iiace 42 xvouki c^uin<^r to be 

phv^3t,s m a ]ear>wp ^rsiiOft'iiLm %U!t i>p?.<,if then Kors gti^phiCi.. ami opuonsi couid 
tetlect an edot^ttoRal env^cajmeat wtth ph>StJt.s related atlribtJtes, etc, SitiJiiarJy, m 

a busmess eaviroamcst, sttnbates aad mtrmn coijid be tailoxtsd to a "eraployee seryices" 
coMext, for e^tample Otice the feedback mterf^ce has h^n chaaged is step 305, the 
25 pt <,omin«cv to step '^{M- 

1 N ^Ocs 15! i ^ m Shi t ti o -> in Jx p \ ^uplvlroN o^^ ? t <.^itj<,tt,<.^ 

MttulJon.jii.OR Ir n \5 s ^| n t i i !>- J !f< s ss^n.^ cJ to sU i ^'s 

tieid IBOoifeta^Kkte^vf^d i 4 Thcpoctss? nrcotuj k 5n*jo a.V f\ p ■>)<} U 
30 the <:rvut o« i«.on w^S5f not s^te^ted tn step W step ^12 srsM < - 1 ' ivc t the lo& c 
cheuks ■« hether a f^spon*^ ^co^ 88 has been &elecl<»d U h*. dt-o is i }a»i&d to sho%v 
the ^^.kxtv^d ie&.paftse icon m sn^ 3 14 and the re^poi se d^ta i si sened mto Pu<;poflsc ficid 
I h2 of the f'-edb i< k rwo^d (t>«-*cf 1 6 tl 0 p X)C<,ss 5^ then co tplete at <5tcp ^ tO 

\ i >o V •) I q 1 (Kiosii i,hvi.'>- io Ov, r^ur 

^ 5 - ( 5 5 !f ^ 5 I h^. hi ! i shn'-M o - iUia'a nS4 iff 
t T i, h iv iXvO u m n\.p ^22 The prau ss then nnlete <»t vep ix* b rs. s * Vin^ 



SCO!) was not sctecd in step 3 IS. the logic ch&ckh \t prompted feedback M 7$ or I5B ha?^ 
bees selected step 324. It \hk field has been selecied, m step 326 xhm prompted feedback 
entries are displayed in n popup window UO as shown in Figure 6, The pre-deiined 
steibutes aBd/or messages itssocmted witis the selected pop-up ei«ry are snsejled mto ih? 
5 feedback record ia step 32S the same way as any other (rnanuai) feedback eBir>' sj> mse«ed, 
aad the process is complete at step 310, If the px>mpted feedback field ws« not selected at 
step 324 step 330 is initiated, m vvhicb jIk? logic checks message xKput lia l>s;ej- eniereo 
mto message window BO or IdH. If so, a field uidicafeg the ijuxu mode and the etnered 
message is inserttui n^K> data portion IIB of She feedb^Jck ^c-::o:d in S5cp 532 v\hen the 

18 iciirncj selects a "done" icon or «-Blkjf cosHroi to indiciUe that he or she is f'^nu-hcJ nrpatting 
the message. Ti-je process k contokte ;u slep ? 10. if no m.\\-;;!go ;-npu? Ij received ii; step 
330, ihe logic i:-hcck's ii anv other icons have beco selected ki s-cp such a^; oOier 
Sittribute icons, nxcxm heading,^, or other pjofupts. If so, the selecuon is processed 
jicoordmglv -n srrp ,-530 and the process is complete at step 310. If tiO selectioji is made in 

IS >K p 3.'^4, tha rsoccsv { co^i^plete as indicated in step ,1.?0, 

I t H i ■s'-i.s. ) 1 t,> J i n hf 1 4SLS.SS hi^t>i;e- I *, dbed as it" the chedang steps 
rot 1 S < iiid ^ -iic i-iihfcx c n ^ever, as will be apprecistsd 

b> no'-e i i ea,t cLj-c su h a vhv 1 hni is nor speciScaily required. 
Rath - tnpr s lie w 7 ^ ! ro r 1 t j; s 306-308, 314-316, ,">20-322, 

a? 32^s ^ b ^ " c (I t \i n \L iwhencaUcd. To crj the 

fun^tuHNi t<\i.^% <.r<.^nMkai'ii \->^K it In k on t,ic. i« the feedback interface, 
Altv I \t tiKv vOvId be called b\ e oju i ? t.nn item in a pull down meats, by 
ke\bo=i I.' <. omm ^r^d^ CT nanv other ml ihk nmixf 

iiji-ir >4 ts J k>vsr dugtwrn H««!iratf if «step 295 of Figure 20, in which 
2.5 orgs.a? o ^ tt ks t>d j enon-^l rtibu ttx. tcLstrv^J nd ifs.sened into the feedback 
iOi,i.id 11 o^uu^'O il I'iUHts. ""^l-t ^ K'^ii t*- "jutffs 5 ;6 cim preferably be 
auto n UKai \ d3si,£„rni 1 H S \t t \ tn n 1 m jj .to trse rccmd. Tl)i,s aitribute 
iRfOil^atJOt i igr i i u,sfcr ai ?.;n carl -er d;.ite, for 

ex!.rf>s- )r n i ? 7J i\ r ^ d fiba\'- o-v^j i tut work. TheKC atuibutes arc 
W> n-.s- i t I ! ot mto **fpropr*ate fteld&. such as those incfeded in other 

aruboi I i^s i R l'^ 

The p ocess teg ns at MO, and, m Atp 642 ortjaui/atsoMi levels are retrieved and 
m^vtrkf f5k"! tbt. <. ?b..u.v. tc« rd Sui,h oTt >.m/ h >r d 1 -vt inchsde f.nc identification 
(a doE x-j 5 I Us 1 h ooi| n\, \ , -iaai , ii<;uic!. social ckib, or oihcr 
35 orgaoiz^stioc <d ^^^hseb dso i vvho entered ih& feedback iruo the feedb«ek .rei,(.>rd in stsp 
292 of t c'*.r<. 20 awsrtvr. In n&xi step 644, the (i^sk of ihe -.sser is reuicved aod 
inserted iuto Qic icc»<ul to step 644, "task" refers to the organixadonal atiribuies ,Vi4 



indadmg product, sen'ic8> job. task, ineihod, procsdure, and/or re.source of the user, as 
Hstsd ia Figure 2S, la aext step 646, the wser identity (e,g-, name) md demograplvlcs at« 
retrieved and inserted into the feedback record Other personal attrmutes 516 can also be 
inserted into the rscord, as described with referenes to Pigwre 28. In next step 648, riie 
5 time and <Me when the «ser accessed the feedback bterface 42 are entensd nito the feedback 
recotd Itm the appropriate fieM(&X The process is then complete a® nidlcaned a( 650- 

Figure 35 is a flow diagraiu illsJ!>tr5it5ng an aUernate method 660 of coliecung 
feedback in a feedback system of the present inveation. The method 660 is dia^cted 
towards & feedback Interface which presents optioas md collects feedback using voice 
iO input and mdm output. Such m emfaodimenj eas be utilized, for exjuijple, m a telephone 
answering niachitie and/or voice recognition system This syj*tem can be eotssidcrod a 
compmei environment m that presented optjcns and <^ users iti svo-h a ^sstem 
tvpicajl p-o e-^sel <Lmr uo-^ntf ■^nsnnio contsohc 

1 hv- pro'^i. «;s b-"^ ^ i fi"* in n-^c>) 6( 4 * ^>^c I I ( I ^ >( rot 

b^' ortOv't i .i. ^Oict at-jv?- -iiiMXi^ of tl«e select orN vbich tlx as!. uu <.hx. ^bn: l>\ -^Ik-i 66*^ 
ihe feedback mterfa^ revcn-ci, a seiectsos xmm the user la tlwi example. She u«er car e^ter 
itelecttoas tfeou^eh aa mp«t keypad such as* the buitons on a tdephoae Alternative j , a 
Ui»er can speak i,eIectioiis which ajs i^cejved by a voK^ recogmtioii sj-stem The user <-au 

a) preferably enter selections mcludjag a context and attnhytes m response to spoken menu 
offen%& Irom the feedback jaterfa«.6 In step 670 the feedoack laterface f-w-hjch can be 
«. ontroiied bv a CPU) chaks d tlierv ate moje sele4.uons from the user It so the process 
c'um^ 'o sr i doo to p A.stm the asaslaWe sseiections, sn h js -^nofm r -jienn < H v uset 1* 
t^K u^!S:i s ;o* n i.c mon. se^ea ors jn step ^''0 thc« ^tct; t i-, ict t i m %h (.h 

2B thi.kt.ib \!fti"r Lfrmrs u> '^hcdbclsnvs 11 ij sntut i <l k n 
t J I ( f a? I St. ^ t vi t- tS t. >j H f) f-'sc''- iii, ut^i i 
J ct. \<.s tc t.^ f M «i 01 X I ^ I hi^ n5 J t (.\ r M 

pxv e v,Uv b', ^axs fUtun t ^itfw.ie ti d.isjriLf na u )p| }p 3 ic su n In 
M Mj.p 676 the teedba)..k tatvdsce sends a sertd caacel protnp*- to the user, who thm has 
the optifn to \'*ad the cuncnt feedback jtm to De stored *md acce&Mble to a reviexver ox to 
c<L5ctl the iUt j-ej I kx dback item If the li^er na-^ opted to feeud the teedoack it^stn m step 
TH a ttfedbaiK re<.v.>r \ a» ^howTi m Hgure 15 is ij^ltd \^ith the apptopnaie intormation, 
«id tl^e record is ouiai t ti> stoi age bitk,k 44 or otk r storage meduBi *\ttef *he record is 
3vS o^itpn* ox ihe «<*er has '^o* s'^n* tts a<,otd m step 678 the proce^^ {s complete as 
indicated at 6S2- 



22 k a t1o%v diagrasTft illastotmg a preferred meW 340 of ii 

:rtace 46 or 46\ A reviewer oas, at imy time, access the viewing 
interface to acce?.s any feedback rsco^d.- stored in a databa'cc, Tfe process !-5©gHi$ m a step 
342, aad, m a step ?48, the default revtewer prefet^ncc^ arc read. The preferences ats the 
vievti g interfare sckctjoos and prefctx.wcs that the s-evkx-^ei has &s.jgr.ateii to he apphe-1 
to the feedb^ick r^coids whttn&vet the vk'wjng Jiiterfaec ts fa-st Acce^^cJ IX-tauli 
prctojersce^ csii be considci^ed a "saved setlitig" of sekcuonji wtoch are read and applied lo 
xht pvesc-nrcci feedback data. simOar to tbe saved setcitigs 252 described for vknvmg 



Ii3 Step 



3 344 is optioisai and deperuient on the charactef sstics of li 
that has been implemented. U step ?44, tiie i^viewer's access to the feedback i^cords is 
read i« by, for example, a CPU of the computer system whicb is beiag «$ed by the 
reviewer- A specitk reviews? might only be abk to access a cenain poitiott of the feedback 
records stored in the database due to orgsmzsiioRal jestiictions or necessity. Access cm bs 
IS based on a'.trihutes ot other ilelds of the feedback record?. For example. <5 k-a.^her reviewer 
mighi onh' "^e ahlo U> accc^^^ u-cdback records relauni^ to bis^ i.>r htrr own coursse, in a 
pii>'Sjic-v cos^icxt, ii oUit'! 0 uK'di:'>i£'u; , the kcdhhck rec.jai Jansbase can he par^uamed 
mio different <jroup> or clu^tots, Aiii.. a le^it^wt:: mi-^hj or^ly be ahle rs> ckro\< .i hn^jted 
number of group?;- Once the CPV knows the rfiv}c%vcrs access, only *he accessible 
3(5 pottioft of the total amoust of feedback records Is mad i 



Also within step 344. a defiaition flie of ii 




The CPU needs this MbnaMott to 
tree,^ 250 a.^ shown in s-iewst^g 
is typic^ly dynan^ic, the (TO must kno^x 
or locations fit v 
23, 



Iti step 346. the database of 
pt>stferabi\ created in rnemoty for eacb allowed 

b &e reviewer is able to access a 
r record. This step ts described in more 



1 and 8 x'iNuahses rccr-fx1 h 
That Is, y the feedback 




e to Figure 23- fnati 
2 block 44 so that they may be 



[isetof feedback recoMs as detenmtted 
by the default reviewer preferences read in step MS. That is, the accessible feedback 
rocoros arc or^aoigcd to be displayed according to the ic\'iewef preferertces. The combined 
.^et. a.^ cxpiaiaed previously, is the set of feedback record,^ that have all the attribute,^. 
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citstev lotfit'O) f rxe aod >-4^ei quahlsor:* «,un-emi> seifUs-'d m tlx \xn't»rg 

smetfa'c Stifp in iie<;ci bed m nore deia'} VKm ^ nb (ctcivnt,*. iO Fj^juse 24 

hi <-p 1 0 { 4 v<vs,?n s i «„di/ir 5< ? 1 Jt^f. t 

5 V s.-'i Wi-^c %U u it V Jii,ttnv6. i ill M, \i,«n. iUtf,r^^'ies 
v4iw.UjaieJ m kp sini^ o %, h a}c cut*, i^srij^ur ^4 ^^ h\ii\ liK sou's c i-^ 

chm fevcis la step 352, vje^ver mpm tmves^ed asa *Jhe i.hspla% of ts c j g .^leita^e 
updated in ac«. ^>rd^}n<. e w *b th< vte%e'- j'^pm Step 352 d«;»«cnt sd r\ iunhcr dofad %viti-i 
refers -^^ \ ^ itia^. J!'^ 7 v pKa^<- nt > vot r> ^ ^ <^s mdsrated m step 354 

10 Figure 23 is a How diagrstii illnstra-in.g sjep 346 of Figijre 22, in whkrh tha 

database of feedback records Is sca-incd aiKl a visuairzer record is; created foy ecirh of the 
feedback records ;iccessd.>le lo die reviewer. The process begins ia a si,ep 356. and, in a 
step 35S, is counter "i" is iidtialized and checked if it is ie<;s rhas rhc ijua-ber cf feedback 
records stored in d?» database. If txue, fhe process continues to step 360, in wbich fhe iogic 

IS checks if tl5e re-viesver has access to record(})- This is preferably detennsned by eosnpating 
the reviewer access, which was read irs step 344 of Figure 22, k> certairi fie-ids of ti^e 
feedbsisk record. For exsaxple* If the reviewer's access; is iimtted to feedback recotds 
havmg a cotitext of physics for Mudej^ts in the Mi district, tben the GPU examines ths 
context and leaiBer tetsos lieMs: of &e feedback xscofd to dstermine if the feedback tscotd 

20 is accessibie. Otjs method to accoinplish this is to^isectiy cottsps^ the coatext heading ID 
nwmbefs stored m the feedback secot'd with allowed context ID «amlssrs. The CPU cm 
also check tiie closed I3sg field 2i2 of mcord(i) at this time; if a feedback leeofd is set as 
'^scd t 1 fcn td O sf L-it, "evisxussr has "Specified th&t she doe^ not v\ar>. ^o Mex^ 
f V ^ is rJs c h s e 1. s id thca the CPU caj> reati the n-'ad sf< tus Ib^g and 

25 e - J ! i) s n-^i^ i<.i^K.t 1 OJU ti fccor Is ard uTi. ! u\-<* * n t.-'v fv<iJ 

s f i CO his ^ u t. Li r \ \ u i Si.i\. .\ :esjes.e£ an L ^ ^.^ h ' r * 
vi ^ 1,1 s;. I --(i \h iccojds oj (X'k.ojd'. be she oas alriadv r>.avi a | icrcu\xt m L-t 
vievvmg mterfai.c 46 or 4«s m <«tep 352 of fegiire 22 

If ihe feedbai.k record i<> not accessibJe hjr the reviewer, the prtx;ess loops back to 
30 step ^5*?, ^ ben?5fj couDter i ts mcrettiented and the next record scanned. If tbe feedback 
record is accessible by ihs reviewer, the process contitsues la slep 362, which a 
Y!sa.iah?cr record is created, pa^fexably in RAM convspoiioira' iVedback record(i). The 
feedback recoixls are preferably stored m RAM or similar meirsory wish u reladveiy fa^t 
access thiie so ih;it ihe records, can be seanned and preserved to the reviewer qifickry If ?di 
35 the -.isisaisi-er records cmnoi fit hito the avaUable RAM on a system, other jncniory 
scheoics can i^e ysed to supplement or replace RAM, snch as "virtual memor>'" on a storage 
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A preferred visuaUser record stnicture 368 is shown m Figure 23a- The visuv^ket 
fsco^-d includes a field for each filter of the -viewmg iateriacc for storing aj) index to 
segments \mhm the ftlter. As? imlex describing each segment stored m recorsKi) is stored 
m the appropriate fseld of vlsualt^er record 368. For the attributes 224 or 224'. such as 
5 sau;ui(>rs and sharitig, the number or other tdcatifjcr tepresenimg the- ssgment ss copisd 
ijirectly trcra th<£ -Mxibixm fkld fiom feedback fecord(s) into (he appropriate index fjcid of 
ihe vtsuaib-er rt-cord. <<vhi>wn in f'igurc 23a, a situation atlribisl*; hdex field 37f) of rhs 
vi.sualizer record slorei. ihs; »e^::nk'ut namber of the Mtuatinri attjibofe srored in xscoidih 
Foy O'XaiKpic, if records 0 jtn-.:iuded a problem" J^ituatioit aitribuie segmeni, %f-ioh is the 

10 third «i:<;rnem in thsL' ssiUiiUisn alinbute fiitsr, ihs-n the number 3 is prstend-iy si'jyei in the 
sltuaiiou atuibaie field ISO of record (iV This siurnber can be n$ed as dn -n^cx. and 
ihus \s copied dlfcctly to the ,s!?\at^'Sji i: do : rield 370 of vi»oalk<er recoid The 
response as?d sharing auribiue inJexes are ofHained in a similar fasblon, I he context Held 
194 of record(i), however, might inciadc a list of category »ames defining a context path, 

iS such as "Technical/Testbg/Anaiog Testing" in enibodinietJt 42, artd representation mode 
icon/speciftc feedback icoa/seiected phrsse is etribodsriieat 130, The CPU am convert this 
caiegor)' context to an index number then store the index number in cotjtext iadex fieJd 
374 of vistialixet record 36S. Other attributes, such m techsiicai attribute,^ 512, 
orgaaizatioaal aUribstes 514, and personal aJsribtJtes 516, csn aiso be stored in iields of the 

20 Yisuafeer record 368, AlterKalively, these other attributes cm tetnain iti feedback record 
174 atJd jfetrioved by i?iewmg interface 46 whesirseeded. 

To convert « context path to an index nmnber, the CPl- can oxaimTic Uk- cunvni 
context orgatikatioftal tree structure from a defmiiion tiic ioadeti from the database. As 
^hmvn ia Ftgtite 23h the context ofgamaatiottal tree has semai categories 375 and sub- 

^ categories 375 deJBned in a pajticuiar tree str«ctiire. The CPU looks at the coatexl path 
specified in ti^ord<i) and traces the path in the defjmtion file tree by matching .strings (or 
identity oombei^) of the record's path categories with the IE> xjumbers of the catjegories in 
the tree- The index stored ia context index field 374 is the ID number of the iast category 
specified in the path. Thus, in Figore 25b, the TO mmbsx: of the category "Eirsstein" would 

30 be stored in iadex ftcM 37<1 for a path thai defined a crsiuext of 
'I'^hyvics/History/Peopie/EiRScein". The kx^ation orcanji-.^itsrinal tree^ aa; m-ipiemenfcd m a 
siaHiUf fa&hma using Scamer location index field 376 aad autl)oc/respoasibic person 
location index field 377 (field 377 is aa optional fseld in visualijser lecoM 368), 

Th^ date index field 378 stores ai^ index represettiing the date artd time when the 
3S user crejJted the feedback record, Jn the preferred embodiment, the date stored in date freld 
190 of record(i) is coswerted to the rstmiber of days following a predefined srartmg date. 



St 



■^hik j&h.iOiE'ai-^iiae sj<k> iie.di''S lor example livditetanlvcosucitod tjt^-s atjxicx 

5 r <. hH''' o\viv>', t iusss iH t o'->. s-v!- is aa<j 5vru n h n 'I ? x 
'stiCi.teJ lole \je\^s;i 0% <dre-VKS.\<.f .miltci.»jjj (.(suutu.,' uv^l s^< to ^LSv^^tit. 
mes&age dau Os/oft ilag f eld 3^ s ysed to More *i flae md v at! tj? u ix.i. -^aS n ts . urrv?^? r 
on Of off, J e if rec<H3d(s) js m tbe diSpkved ccrnmned ^ot o*" txoi Th s >.<j" ^ < - h - > \ 
a vs§us1 CPU to dote xame whisrh record*^ houM be djf^iayed n. t jc I ^ Sj,\ 'fk 
10 J ecurds. which the tvviwer w hes to v e% (descJbed w Jh refc'eBt c to I „ ^ 

Re^^mn^ 'n'^ to Figwe 23, the process (.wrsnucs t** <;top 3t>4 is ^ 

I'ii, ri^ <ja. r„ id Ti f o'n fiic oa*a^ JSC su I 1 1 s n U ( i nil o > 

'^>.d ni. k vc Oi Is (tk > 5, . CO i s uui i^ i s it he f s r 

is if>'spshx\iosq "^^s j« \ hi un ! s ^ ; 5 k . o'fli > ^ \ anm^d 

vSs' 3g tj «; >,4xr>>i oixxe^s k)«ve t 5<v wro^^^o^ *h«ii o. sDtji.«^ I v' nombvr'- ot i000"L.s n t 
database, the prqqess ts eomptete as indicated ia step 

I )<nrc 24 a How diagram iliu«siratjiig step ^49 oi F ^ure 22, m w h.^ h the 
^,<>i-)^m >. s-j ot feedback t<,cord& n cakukted Tlie process, s^txirt'. u askf ^j^s -me m 

W ^K\!-^^,! y^Li tiu ^t:j:a^«ai.couii<m >of ^uch tiltc-rscgnxm iy:<^v<eaJ■!i(* I: < >. vpmosit h<^<, a 
' ^{» i s i'i { c <s > V. dva V n v>hi >^ s uscJ i,?^) i ihc > m-^'^ of % ^ di?!,. 'cvSf t. 
iuiva5j:r Usas segment wnjch vM\ sddcd o: «u:-<tracted from th£- conibined set. This 
c-''isnfrr aunsber Is used fo dispiay u;e. >*ar chart If \ei;- cv:>i U.i^ huii^ber? ne\? u> hc-idiOSs in 
organizatK5T5^1 trees m tUa V!e%vir5g jBlcrtace, Each s^grAcnt uko hi\$ aa or^/aff Dag 

2$ sssociatsd wUfe jt which js set when the fevjewer selects or d^elects a segixjent (see Figjiis 
27). In sext step 392, a coumet "i" is iuidalized md chiscteed if it is less thsn the number of 
vlsualker records. If \i is, step 393 is implemented, in which a variable STRIKES is 
iaitkiteed to zuo. The vanable STRIKES represes^ts the autnber of segments in the 
visualker record that are curremly non-active, i,e, xmi iisciuded In the combined set of 

3D words seiected by the settings of the viewing interfsce. 

in mxt step 394, a oo^into- h um^.^lrcc iixxn che£}:o<.1 if H i^; k-:? duus the mjr.iK^r 
of filters in the current vsjiuaiixer record. Hercjft, ihc atliibulc wiudaws 2?A and 2?A'. 
organisationaj trees 2S0 (and mndom 2i8» 220 and 222), and tiine controls 268 and 269 
mt ail cotisideted filters, since they all can specify a subset of feedback records to be 
35 displayed, In tbe exaniple of Fig«r$ 23s, ti>ere are seven filters: the three attribute filters, 
ihree organtzstional tsee fdte^x (a context i^lter, a ieamer iocatjoa filte?, a re.sponS3ble 



pe?Hon Mithor kx^j ion U sr) j;nd « d<iic f Irej AdJ.nojwl inters K&\bc pu^ t?nKd j 
Viewing mtejface 46 or 4o uj o&er emmidsmeMs. 



r \ 10 1 f!D N( U50 N I ci f? > s s 224 aod 22 *■ us ^ m i ^ s < 

die designated context 'segment n the v si ak^er record s adudea w L m th<. >,urrenii 
10 elected context catego*> For exaxBple, if the coaiext miex field mciudes a co text ot 
"EjTJvtexn", the CPU cht,<.ks if the ctHxt, tly-sdcsrted context cdisgorv a thv. xKVt-jn^, 
inteif^ce mciude*- 'Ems ej«" ^ a ssub-categ ty Xi phv^K we e the eu ic itK etcctt^d 
coatexti the ^gmeat ' Emstem" is mcluded witma tlmt eostext calsgorv asd th«s ts 
<;ot«»j(iei«d act ve The CW p efe aWy yea piedcf ned orgaij/ati<. nai siruu^'x fo 
IS t.0mpju^ the context ndet number \'^ith the xjctt-ve tontex and detenmac if the eoi text n 
lecjordtt) » aetsye, A sisiiiiar procedure is used iof iocanoas dates. 

It the segment de\{gs«ited m tdfrij) ''<n\c ih^ tK ^ ovv loo'-". '>av.k to Mtf 
394 to Hicrea eM 'V' to th^ next filter If the i.eme«t t fiUenp s^ not ac i\ - then step 
IS ti«^lemi,nted, t wlui-h STMKBS mcirme ted I v one and a "vauaable FILTEiRNUM is. 

m ot al to tlve cuiwj t value of I ^ aext step 400, the CPU checks if S iRiKl S is 
gi«;atef thaa m squai to 2. Two or more strifceis tor a visuahxer record md tcatc that two or 
more ^etment m the record a'-e vurren ly luactive I or an i active sesmvui u iunftliec*) 
n \r ch-iP li m oh%c;. showj, the amotJ \t ot teedback records that 'II added to the 
*,0i» b Kd -iS^ f that *.$.v,ait.nt s checkcc It isx.ordu"> rjas t%o o nnre stt i^cs then tvs^o ot 

25 mo<"e se^ivn^s , 'c tjpxhc<;k«:a < -^d revOU « ) v^p' tioi be added to the comhried s i \ her 
Oiiiv oae ot t»>o^t inaotntr su«« t h <„i5u.kxc Rvcorlf ) should theirfojc nor i etc «ciu 
<m\\ - ^iK-^inerswhc^ h is uvo ^-^r on ^ 5' M x M\ since it vaiiiiot consTibate 

^ ?if J 1 li Thos i* 'sTRIkL 5 ^ t io'- sore) the p oces<; toop^ 

x. o ) M I -ic rfudt-d ti> i V i.0 lb nv.a xw til ih.,^ sc^.tu-' ^ a u ? o ^ 

rt. tM) i.5 i>li^,^nJTibu«tolhe«^UTif{Pcd>l>arv,h<»rt e\<.ls i^^'^pstv kOs.>s1^\U\ \ 
■«9^ \xi vha"*! the coook* ^ is jocamc^rtc'i and tnc > ^\t tj' ""^wui k u h ^ 
exanisned usijis tne same pr4>cess, 

35 KnK I 's }ti,n kt t * n ix- J\ ui \ m ih <.! i <- Us 

either ?! f u I i I'^t ! ! u -jcv, o J i*vt i 

recOuU^ k > a i oM uxit, i r% <-ux.u\x h h*; ie\t vtcp 401 I v P( a s-sj 
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BTRimH ^ 0 or } . If STRIKT.S j,n e^nai io I ^i.e, nor equal to 0\ then r*;cojx.J<j ? mv1ude.<^ 
one inactive segment, f^iep 406 jis implemented in step 406, the- ssegmem counter ot 
tl>e jnsctiv© segmsrt (dcNigaated as filtcf(FE.TERXlTM^^ }& tnacmcated, Tius^ segmem sn 
the only kactivfi- j,egmeat m recordO). Skce it iS fee onh juaetne segmcat the s&gmem 
S coisnter is incremestted so thai a bar chart will be displayed (a» mmifsd bar chart sxgnitymg 
the amount of feesSsack records feat wl33 be added to the combined set). After 40b, ti^e 
process loops back to step 392, in which counter "f ii, mcfs;meate<i so that the next 
visualker remtd cas bs examissd 

It SlRlK^5? does equal zsio in step 404, then recofd(i'J mdudes macth-e 
IQ segmctsts Stop 408 ts then implenjmtsd, in wfech a couatei mitialiyed and check-ed 
lo determine whether it ts less than the tjumber of fiiters in vsuaiteer ieco«3(j). It ^le, sitcp 
410 ss impfcnjeiiitesi, m which the segment counter of the segment designated m fUtO'^O) 
•ncremented, Siace tiie number of strikes equals z&m, all tlie segmetsis of reconl(t) a.a* 
cunrentiv active. 11ssrefoi«, each segment counter indicates* the nombcr of teedbxk tecordji 
15 that wUl be stibts scfcd tioro the combined set if ihsit segment is unchecked by the reviewer 
(filled bas ehastsK Afxr step 410 complete, the prncesi. kh>\^s back to step m whscb 
f HKjeiTsenseJ und i\& ae\t segmet^t of ftUeuj) hj* ^esm.-sn ,:ot;ntes tncremeated. 
C^nvj • - '^x^-^ erro-tvsd abo'vc the number of i'lk-^ m . >*. ,iU?ct recotd(i) la step 
408, tho pxocess Ioop> back to step 392, where counter s is mcremented, 

20 Tbe process contiaaes to exajniae each visaaii^sr st^ord ia memory. Once cdunter 

"\" of *;tep 392 has been inctementcd above the number of vlsualker records, the proce-ss 
c^^mplete as^ indicated in step 412- Whm the viewing interface is displayed, the CFV uses 
Use '^egn^em counter valuers fo display the appft^aie bar chart levels and organisational tree 
ncu h ng nu'-nbcs 5 I he CPU checks the on/off Hag for each segme«t to determine whether 

25 to dssplay a fiiled or uafilled bar chait. 

Tiie cakuicumg step ;J49 dej»cribcd Figure 24 can be imp len-sorf(\^ u<-mt aiu 
methods For example, a do«bi> imked hsi structure can bt- UNcd lo \nk <'J ? . Px> 
accessible feedback records, m raemorx A number of pouuert- tar He addc^ tL i:^ch 
feedback record in mcmon% where each painter tepresents an attribute and pomts to the 

30 tjevt tecilback rect^rd having tiie same attribute ^cgmcat , The CPU can thus count a sencs 
oi tcedHat V recci Js hIooj a smgle pvjuitei "tluead" to deterrmas e^h bar graph level xn the 
V ^ mfed i«:e 4 tCvu' wcR record wotdd have to be temoved fi\>in a thread when one 
<>^ it Mt uvt- v^asr.^ '\ %aN dc^eicctcrt by the revitv,4;" ancl c"ncvooc*n>^'\ ..Lu^d iu . 
* ^^hv''i '^x.'ev Mtrt.^.oo^ ^^'adihi^ r,."Bow^4 tk-ncTSt^ m^ni llr.^^^1 1' ,t , r 

35 o iaKH\-, r;)ONr ^ktiJed ^n the art, and c,«n bs,' ioujsd m ^nch rckTCOces as 11^^ .\it.>t 
i-jSL^^ J^'i^i^^^-inxLLtig. Vo'v J Tnndanienlal Algonihms," by Doaald E. Knnth. 
Addssoji-Wcsiev, \ y&B. 



Figure 25 }s a flow diagram ilkstriUsag step 352 of Figure 22, in which the 
reviewer itxprn is pjxxresssd and tlie dispky is updated accordingly, Tijst is, she vie^ving 
interface wisdow has been displayed witli the revfswer defa«it pmfemaces selected asjd ths 
combitjed sei of feedback records is represented in die bar graphs of the \'arious sunbiste 
5 v/iiKiows and/or organjaatitmai trecxs. The pmc«ss begms in a step 416, and, m a step 4.1 8, 
ihe CPl) checks k> determine whether the psviewer lias changed the visualixatsoB cntena: 
has the vie'v^-er selecced a segment of aji attribute, a headis^g (segnient) i,n ao orgatiixauo^^iij 
tree, a time wit^dow bar graph segmenL etc. These car. also be referred u.? a vi^^wer 
prcfc-reaces aioi-s-defauk pj'erereiKesl If so, ,sien 120 is 'minlemcnK-d, ii5 -vvldch ihc CPU 
10 proee;;ses the changes for the new \ \>uAi/ cnicr;a and ^^ipdaies ihe display 
accordingly. This step is described in aiore detail with jsterence to Figuj^e 26, After step 
420j the proem tocfps back $0 step 418. 

If the viewer lias aot cfeauged tJie vtsnalimtioft; criteria iti step 418, thetj step 422 is 
i«itiated, in which the CHJ checks to detenmne whether the viewer has asked to disph?y 

15 SBforamiioB ftmi specific records. Such iftfofittation preferably inclwdes the nsessage data 
portion 178 of a feedback record. Other lafomiadoa stoj-ed ia the feedback record can also 
be di-spkycd. In ibc xdewing isterface 46, the viewer selects to dlsphsy this inibrraation 
preferably by selecting a control ia message? window 234. in viewing interface 4iv, it is 
preferably accomplished by selecting a t^^ersU item from a general li.st and seiocting a subset 

2Q of j-ecordi* from successive menus. In interface 46", a list is always displayed by default 
in window 554, Alternately, a tllter cati be selected to viesv specific feedback messageN; 
having that tiller's aitribate, date. ct>tuext, etc. Techniques; for provjdijig s<r.lections from 
menas or other controls are well known to thase skilled in the an, Aiterru^uvely, a res'iswsr 
cm sela^t to display specific feedback record content by "doubk- cllckstjg" a right mouse 

15 foiJtton when the mf>use is poititing to a segment bar graph or by s-ndlsriy seleciing h 
segmetit or orgtarizatioaal tt^s headiag/oatcgorv- 

If the viewer has not selected to display ,«pcc5fic teedback records, step 424 is 
irnplen-ented, wmdi asks if the vicnvgr ha,« ^elected tc> qcAt tVarn the vk'\vo\sr iaierlace i"i,e. 
"visuaai'.er";, if so, tiie process is complete as iadicaicd iii step 425, If "qiih" is noi 
dB selected, ^ process loops back to step 418, 

If the viexver selected to display a list of requested records in step 422, then step 
426 is initiated, in which a list of reqiiested feedback records is displayed, preferably in a 
separate -v^'indow or screen, lo viewing intertace 46. the records dispiaye«i in the list are 
preferably the visualizcr records curretuly sn the co.n-jbl^ied se? of sK-lci/ted records. In 
35 viewing n^terface -16'. the reviewer can select a subset of feedback records from metuss; or, 
in tljc idterriaie efrihodimcin, it the vsevv-er doubie-csicks s bar grapli, die records displayed 
in the bst aie tfte vLsnaiizer recoxds having the doisbie-clieked ,segmctu. The CPU caa 
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ds^&tmme xhe number of usuaiuer m the rnnU>mc<^ ^<?f b> cx^mimng on/off JseM 

382 ot each visuaii^cr second u&d mci^arrsfiting a i,ni«5ter appiopnatch Mit£mMi\&.\ a hsi 
of individual foedbsck feco*-dx 'wjthir a speciiied context Jv^ dc dj<ipk>cd, a.s m 



xs implemented m which the ieievted record ^ i-^ia-m n^xi \x c mc^safc J s,o«t<,xjt from 
data portion 17% li, dsspl&jred Ihis content j'i d ^fUncu n ^mdow *5^«» of ^jf'Rjnj 
mt^riat^e 46" Smce the vnnshtst recordN m m&mon' preterabh do not include me^sagv 
10 data or other simi 



number field 380, which is a potnter to the ai.sociated feedback re^on! m the databas< 
Oacc she feedback record is aucesj,ed, the message data cm be scat to the Viewm^ mteriact 
aad; displayed: for the mmmm: 

IS Dike t^erevJe'ftei: has Viewed the feecjb< I K'-,.ti^^dmk•^-^lricq o i <^ n s\ 

„hos.'n iTom the Itfet %n step 42§, then in &tcp 43Z tije CPl chwks hv r rsie rc%se ^ei 
fimshcd with the di^^pkj^ ot sptctfic njcosxis* U not, the procc^j. loops hack to btep 420 to 
redi&plav the hs.t r^f reccrds If ho, thes the proceN«; conntuK-^ ^o &tcp 424, descnbed 

i.h<^ i^^vi is u^ti X aum^t iot snur t.i * < j ? v s m 

revjrd aj^mbution is <.4.!v,uj<ici <mxUh srcsi 'ts di fh^s. i 7 <. jcv-ur -^i.- a is 
a^^ained to be the m^'in embud nicm m thi<» pnxe<*s A sir r pi^ rs^ ^ ji K h ?! n^. i ^ 
for other embodirrenii -^ud as-vie%'kin|ijntertscc46 ^> t^.ss ut^^^ns i. ^tt^>4 4 

2$ m a i>tep 41b, the CPIj check"* to detcrmjnc whether a filter segmeat has been changed 
{ c , elected or unseicctcd. The CPU preferably ^becU all of the filter!,, mctodtng the 
atti ibute filters 2M or 22^ the org^^uational chm« (or eaiegorv headmgs) and the time 
divpkY ^ettmgs (except for time t^^wM3on, whteh m checked m step 442 helo%) li a 
NCgsn^nt has been chiinged, the ptooe«.?> cost .i^s to vtsp 4.^S, tn whjch the fsltcr changes 

30 ate protessei accordm^ to the fvpe oi vommand received by the reviewer This. ».tep is 
dcNCtiK-d m greater mml below .th '•^tetonce to Figut« 2? In MO, the 6&u dtspky 
i^. updiAted mth the pn>ce*>&idd changes, am* the pmces-^ then is coa^iete as. mdicatea m step 
44 L 

It a fohei ^cgnseat wa^* not changed m iiep 43t*, thsn step 442 mutated m which 
35 the CPtl checks -v^hethc- the time resolution ha^ Kxa chattged x^solutioa control lb9 
oi xxcv. sag uuei**oc 4i> (o- vme of fitU^ 223 of mterfa^e 46) 11 the tititc tesoiat'oa ha«; 



been changed, step 444 impkrnentcd, m which tlie bar chart di<^p!ay tn t^Wf uisdovi 
222' nfdx^tcd acc>xdj«g to tl c jk\^1> choices rcsokuioo The pttxes.? is the:j c<.''mple'.e &^ 

^ urnr K'sohi? on v ^< ■ -.\\\Cvi m -ten ^^J iT\en j;*^^ 44^ is Kutu.^\' \^ 

rn-" V, -.ndo^j* ovi^r bat rraph^ cuta-rtly «ut d5s.p.a%eJ, or a scilmg burt>-si r*u u:.!' 272 i*< 
c'unsro ih<i honzoatal asd/or vsrticai scale of the time bsr chart S»phs . If a ^cn.^i 
scaiiftg bun* has feeea seliXted, ttse bst chart display i$ a|xJ8tCi3 accordiogl> bvS>ct; on &o 
scroll or scalmg batton sei€sctiot)<s, as showa in step 448. The proce&ii Is thcu compkie 
10 mdicatedia step 441, 

^t^os^ro'S o*-'. ^ni^ Nif o>)N h fk^tvL.mv,cp '-rep ^^i' s "lUn^ed 

sd^cn a* 0. tlc'O^tvo -"ilcu uoins * tMun i ^ i-^^ s ^ s'h u"\nc~^ce to 
IS T'i$ur& 1 ^^ e>,-5ki nit i NelMpc^ h > n\|^4'-I- x^tkI t-^t. ^ ss 

«.omp etc Jit s,tv.p 441 If a ^.■vs. J setiirias ba.tOxi n \ v c;.. thi'^ ("^ ^ ^.h^i ks st . 
chajige/Cfe*ite sam %tthngh, hntion 2^6 is selected m sscn 4*?<> I* »o st^p 418 is 
3mpteni<.nted, whtch » diaJog box or wmdow for mpaamg ihe v.h&Tige s<. tt n^s 
displayed M step 460, the i evie wcr s mpat procesised and the cun^tit viewisg mtei tace 
20 vettisgs are stored to a s^ved se-nmgs button TIsc piocess is ihe« complete as indjcatea m 
step 44 1 II noise of the above selectsom or changes have h&sxi implemented, the process is 
complete indicated in step 44 1 and loops back to step 41 8 of Figure 25 Other fillers 
ncou NC Ci.'*jo«s,» icoBS, oi other selec£joa*«! can aKo caa&e the consbmed set to be 
Xvca^uU' c J ai)d the vmoai. djstplays to be updated simjlsrJj to those IliterSf aad cot^tmh 
25 descnbso above. 

in ^he to'^cwoirg e\p anatms tee proce^ ha*; been desaibed as %i the checking ^^ep ^ 
4\^, 422, and 424 of J<tgure 25 and steps 436, 442 446, 450, and 456 of Fsg«ic 2n are 
senalh exejuiited. Ho%vever, as desscrjfeed above '«vith rcfcreace to Figure 21, hucn a 
checking alf^orithm not npsxihcsMy feqmred The vanou*. de&mbsd functjoos cajj be 
3D tmpkmomed a.s call rou£me<: which arc executed when called To call the itmettons, the 
re%jewcr( an ^rlcc (h., a-ssociAEe i f iittor, bar j'rapb rrechc<idmg jcCin,etc its che view mg 
mtvd.ti.v, AK<fix.4U%i.l>, t.iC5 coi»d Ik calKd 0(> s,ei«.,cJmg a mtsmi stem m a puji down 
m&m^ by keyboaj^ commaads or in any other suitabte snasjKer. 

Figure 27 is a Bovf diagram 43S lUastratiag a pR^terred sBctlvid of psooc^siag 
35 re'viewer changes to segmenij^ in a filter and updating the display if tjecesisary. In the 
descfiptioa of die process that follows, it is assumed that the Rt-viewer is using a mouse, 
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pes, or simikr pomtiBg device thai includes Hvo butfoss for mmtiing dsffereat types of 
mpni tomn-^%ids OUex nnut (.Y-vks^ ■«,ferh dlluvt ^ertm mpiH comn^^aBds, such jis a 
keyK rs « <. r<, ' aznig 60fmaiv ^ s <; 1 

j<. ^^-s sua<- i{ k'-^ 16 ^ ^ b {it checks to dcierrnin^; 

S ^ lit.* K s s i ^ Ki > ^ sn 1 ^tKH) m a po-n-in^- device 

U>p»cU%th 1 n n n « "iiLN t sU*v t js- k 3n r evjcc \v;jj, poiam^g to 

a fxlttt segmeni i h {tK r sejn'^'n i be a bx^- cnar* ol w ^rn -s f v J5s| 
of^anizatJOJi tu c cai-ej. me*iv» J e^Jujg etc It such « Si.kt.t.u-i i^. ae, Nkf is 
impkmessted, m Vymch the &eimed filter ie^ment iemsgs an? toggled Oi set t e ti c on*'off 

10 flag in- the feekcted «egiX(e»tJ> are iet apptt>pnateh For example, a momh time spsjj ca« be 
sdected, ma ihis ieiev.tJon would 'set the segmetJt on/ott flag tn o t" evej^' day segment 
occumng wjliita the selected mostb Theissaficr m &tep 468 the tombtsed set is cjdeulatcd 
ai^coraiijg to the ne%v segment selectsoas as de&cnbed Ab&vt with inference to Figiire 24, 
md ibe dispky is updated v.ith the newlv eakukted comfeined «set The pjoce^s t^^ ther 

IS compiete as mdicated at 410. 

It the vise o ^m^w v '^.k ot< a -,k ifnem <;tc]. 4^2 i<> i^mMsr^enteO, m 

whtcb tijs; CPL cfeecU if Ose reviewer doiibk-ciickcd" o« a BUer segmert. pata<ibh ^-^t^h 
tfee sajiie mouse or posiiter buttoR ased m step 464 If so, <,tep 4''W$ ti^pkme'^ted. n 
s\hxvh the seiei.ted tiiter segment ts Eurrsed on u e ijwde active) ^d the other segmeufo of 

20 that tutor a»? tnmM off itnade mactise) For example, tf the reviewer dojibte clicks on the 
"ptx>blem' Sitotioa attribute segment, problem" is checked (turned oa) while all the oihti 
\itaataoa attsibule vegment^ ("qaeNtsm" 'suggesnon", msaster", etc ) are unchecked 
umeu o^*^ If *hc rev e^ver double chck& m\ organi^tttoin lxv. .ate^^ors, \l th.* other 
I t^on-sti iSfc utt itc '«r id olf Iheproce'iNthOBvOtuniacs svp *f R in tocalrjVit*. 

ZS ^h-^ cvsmbmed set laseJun the idtert.1ia«gesajid update the display H e prx)ccs&. i ther 
complete as shown sn step 4?0, 

'^i the t^view did not double th^k on a hUn segment &te } -^'^o i^ !'vp<c-.tcT^ted m 
which the CPU checks whether the vsewet depte^ied a sec«m1 hutotj oa (he pomtiag 
device as. tor exai»ple the right iaouse button If so, step 478 is implemented, in which 

a> sef-Dent \A\i^<i -ue displwed Each segment ha<s a ^aiue a&sowatsd wuh it which 
op(CN" ^hi, '^unibv'r ol lecd! *t,k records H-jvmg thll Ne f ncrn None "t rbc ^Cixnient 
^ diK ^tv >iia.un vaer^ibiv i.Vpi8\eda$btrchdiis Stt,^ I 1 1 rcfcr<Alx> d!v,v>av the 
\ahH 'Oil i!(on-v wdH , Ji o-^Kv i n^<l, hsxivnu^ni v>ih\<.^ can 

o- ^1 eslo h * I Uui i I -<.u<^it Aftcf ;ncr 47$, 

35 1\a irniso^? ' ? sU - - ? i j m^s^.e b^ue.n h?« 

1 V 1 nM ^\ J £ sp ciui tct^-7.^ h'rh^- n^dv. 

f oi ^ liiRu IN idcd&tct l*it Nv,£ n<.nt ^^ikie^ <-r^ r '^ostd .ron. t ic ^Lretin m sk-j- 4$: ajw 
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ibe pH>ce% ajnipkte tndwateiJ i« step 4S4 Tne ssjgraem vaIuci> Oi^ ihm prefctabl) 
di&played onij as lorisj as the nghs mouve hutfotj «n >.o«?muuu5,lj depteiv'sed 

If lije s . I . - i - - .'-^ ! , ^ u V . I o :n ^.t-p ^ ho f ''H cbc - ' 
5 cos vjrrsir^Ks -i^'^ 0&e:~ K.i^v'h ^ 'is ^pt \ i ns .ina sr v.^\n . so sc 

cup'cJ 33Kv^ <i set tyir^vrt^rv hiters. In ^!.e^^ 4<>'0, «i >. umfOifa\ Lifct.s aje aJ,su<sled u 
sjmOar fasfeioti m descubed m s»ep 474 when a double chck is selected, i.c the selected 

ID segme!3t is turmd on md thfs otfeer segmems of thH Mt&s tatn&d oft M M&p 492; tlie 
conjbsned set js calculated as described with leference to Figure 24 usmg Jhe tempor&rv 
filter ^cttiiigs. hx step 494, the ssewiy-caiculated combined set js djsplayoi m the \ jewmg 
mtetface, !b step 496, the <2PU checks if the tight mouse button has been yeteed; tf siot, 
ihe combined set based on the temporary filters. co!stew« to be displayed in ?tep 4*>4, 11 

is the Hght biuvnj has been lekased, the origmal combined set of the filter setttng;> 

befoiv skp redisplayed in the viewing mteiface, and the process is complete a-^ 
mdscates m step S^.s), 

SitBilsfA ^> I iguiXis 2^, and 2f\ the chocking s*siep$ 4^4 4^2, a-'d 476 and 
of FigDte 27 asss de^scribed as being serially implemented. The various described ftsnctjon^ 
steiBHung fesm these decisiott stsp$ cas dso be tnsplemested m call roatises \vMeh are 
executed when called. The reviewer can select specific buttons to call an assocutcd 
toutifle, AIteniati%'cly, the rostmes cotJld be called b> selecting a menu item m a pull dou n 
itjenu or m mv other suitable sBai^ner, 

Mthouf^U ciii\ <. .\v crinUir ih& vr&-,&'x\ >r!\oii \>. n h<" hec« dcwthra in 

otVr jipdf c lonns withou" dcpartuig t-rsm rhv" spAi.t u >^c<m .^-^ the m^-.^nun- 
PvWU.^jlarK, j^l^roajih s.pcciftc usei mtcifacei> have bt^sjn dv'Scroed xor obla.u* .7 tK 
teetibijictw rsoorxls^ tt shoald be appat^ns that a wjdo Vx$nety oi dsttcre^it dii-plo ^""Sxcd 
mterfaccs. can be used to obtaiu the desired teedback. In addition to di.splay bashed 
iiitertaces,, the interfaces couM be voice activated or receive iuputss tferongh a wide variety of 
dit^ercnt mpiJt mech*m5**mi» as^ well The actual contents of the teedback records may also 
be widely \aried to s«tt the needs of a particular system For example, in simplified 
s'.^v^n'-, man\ of the dei-tnl^ed fields mav be elmuialed Qnz <ffl\c- ^cvm.vs >>1 the 
dc\<. ! jbcd toof'^a 4 ^vsk'm ihLt ho u*<er si< giveji the >-b \n\ 10 \ i v< ^ ^ iSK t \| .xiic 
35 iHti ibutc- Uui uescjibe rhe «ato^x^ of tl^e feedback itsdf Altl^ouah s.pecitlc atto-juios have 
hrt^r dosonhod, the appropnate attributes for a given ^miaUon rmy vary wsdeiy md may be 
wjdeiy v&ocd. 
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StmjUrl) , although a ff ecjtic % ^hi^dt^i^r mtenace lia<, been descrned m dot i 
"houJd be spparert tl^at a W3<3e va oi> or altema i%e vibuali/er saiejiaces i-ouM be i sed to 
visaAli2c the data n aeconJanCs w th the memK^n. bor f \ampk, tlUers, bai»ea on the 
orqaai^atioual sm emre of ih« revicwmg i^ixmp iuve been ajK^ussed Howevej, m mars 
5 ipp! (.-^tjcfis <;) ^.ij <L t'itv" n$a(!e JOt lie n^>.fN^in Sus Lrt> the of dan ba&ed 

0 ''«f I h", s .OLdl Oil -xi ,n<. 'lefba*. k soiMC^ ♦w^ lx?«5i le^^cnbevl 5r coaja icttm wilh (be 

jittve ol art.. ' Wrsn/t-i -iM b "et.essa-'^ orev!.n dcH5<,0 \c^OKknf'^ n s sen ^tc.a^. tins 
L. un a ass.v^ ^i^'t.'^t vi^i ^.^5^! < o^.t. e^'uisn 'tsa K 1:. the da" vJ. s,- ' j ikc 
10 nu-r . <.!,-^ Mi !.v uki .1 vo K d rod \ -.>sku r blk'nn" j4..oh,tck, u w s H ^ ,<-J 0£ 
t'\ i jue <■ I 'h- iet. iba^K . <-iKo been acscnbe-d Oovtc\€r agam 3« main £.ppbcatto^fe, 
th ^-e w iU ho o ^cc > > psovide such fsltenng or even record s«cli dau m the Mback 
tscofds SB toe llm place. 

The feedback system of ibe ^mgist myemsou has bees described as applied to 
15 ^aiious^^pecd* jmflerrs'nration'i bore-xanple, feedback sr a<.v.fsicuiJOfi%vtth 5 n<;nuctioiai 
ma\Tiai^ m<nuab ptoductv boui^ tes»£ed by u^^ers, and tiAJ una x\aicn..i arc ail 
vo .vnp'at^'v' 'lO'-Aev.r it should he apprca?tcd tlutt hcde^^nb^s. ^"vcH^^ k svstcm .aa\ 
K 1' iVf-^viuon o(Kn Mti\nion<, ^is wed lo~cxanpl dv^v^ oed teeuba<.k 
ssNtC) i\ ^ u itK> i\ i sks.' dirsctK mto t> odacts so tbu nrsar ^^u'^ts c n. ntmaalH 

CsL-^ sxKo bs> proviaed as a.n adi.'~or d<.sjce kx ^> |. 0 ^.^ si'isa pr^tt*. ^ ^jj x\iMi)le' 
teedback softwas^ modiile cas be added (o r } ouSer v^*' ~>i ^ Sv''*h^aR^ to 

pmvsde «sej iecdback xv«hin applicatioij piograniN prcx .oo^U bcu.g u-^ed .he ^.o-np^ t&c 
sysitem, such as word procei*'5ors!. S n ilmly, the feedback svmm cm be used m 
1-^ coanect m v^tth at tomtisd tdecosxmiunjcalions squipmest such as voice m&i\ sys^tems, 

1 mactive TV act* vines, home <ih<. ppsng, automatic answenap &ystsins, ami a«to latcd tele- 
trasisaoton svsttn s ir cm even be mcoipoiated into devices «ch a- -^TMs., photocopv 
nnoh v*n'' ihe hkx Th«s, u ^feudd be .ippnccum'^d t *bc desi,nbed feedback sy-ten 
c .n h.-* £.ppl'oo 'o 3 \s 'do x < n o> < ppl it.os.s k sojTit. su> b sv^rrs t may be desjrable 

^ sO MSI K( Hu n ol ^ o < 0 o^ .^r-Ths '-icn-v ^ so dj unto t.-sual --e Ih iil 
" 5c?vb.<.- h i.^ in ! « ^ LH h h-v n jc n K.er.- 1 i-> du<t{ , 5nJ 

jiot st-K t \ ^ a~id ni.' \m entjos n rot to tje Jao-tssa ihe deuidfe ^ tx-cn be^a s p btJ i: i t 
modified WitMa the scope of tise appended dain^s. 



CLAIMS 

S 1 A msihod for acqasnng isser feedback from a is&er diirmg opomsot) of a 

mode ctrntTj in 1 iK<y user m^v acuvatc to provMe feedback whc'Ti^i when m enret 
ftedb*tvV ju ^de i^csumijid 5- rev.erveJ, me me&ad compnses the steps of 
cteauass a feedback smsj-d: 
10 r.v^e ^^"-^ ^i^f's fee^ack context '^J^i&ia a product, prcjce^s, s?r sen ice jo the 

tealoack record; 

displaymg a muiuphcity of aunbute tndscis that the user may jieieci to ideniify tlio 
jiEiuTs of ths) records^ ieedbsck}. siid. 

mjordiag attdfetites selected by t) 

IS 

2, A tne« as* recited tit clam i futther compmmg the steps» of n 
each of tlie oiue at which the Mback i& Made, an mdtcatioa of the i^j-sical locatioia of tl^e 

m S A metiiod x<A,\i&a m Uatm 2 sulher comprtSiSg the steps, of 

re«.OTU'i^' con jr.snt«v tiude i>> tH user tltc feedback reccaxi; and 
dsNpkyitjg a feedback xaessagc bax oa a display s 



25 4 \ wi-o. 5 UK iil IV \h,..i K .0 ?h . jk mode IS entered K 

«s.kv.imj i if-e^Ku o'Np.a eJ sn gi ihi ,xi '-ijrin<.!fx> u;J a le^dba?.k dialog box 
IS davpL s i £.r.o c^dK -^k i-^on is selected tnc u ^tlOii x'>^ iUvLJins 

s pUicahfy or imrjbutc jcons th^t sei%-c s^s tl^e atusbute snJicu, and 

a feedback message box arratt^t 

m 

a . A metfeod as i^itsd is claim 4 v 
least <me prompted feedback indicator that i« selectable by the user, whetein wheti a 
pi-^mpted feedback indicator is selected, aa iadication of the selected feedback is $to?ed m 



35 

o A uH^tlb-U ii$ K\'Ut;i m claim I ^vherein Uie anributos rr ir-^an^'^rr. <5 
pirn ahi>' of attnbuse cist<ig«ries aiid jusi <jnc attrjtoute U5 each catc,^,or>' ro4> be i,iota ,n ihr- 
feedback rsscord. 
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a Mtua'ion ca«egO!'> v>h^t\ *^i.lt)dt$ a piuralits of ^r^rjNnrsxndicati-vt otiht n^x >{ 
coamie«ts the usse-r would Ijfce tsj mak^s; 

a sharmg t.aiegorv ^hsch mcbdes a plami s\ oJ attributes in Ik iU\t m %ht^m th 
5 sser wo«M Jjke te kaow the idsatstv of the sser; and 

a i«sponse categon. mchidc\ a pluraht^ of attnb«t«. s mdtc Jtn e oi he n o* 
m&pm$& tmX B dtsimd by the user. 

:i \ tv > ^knit U L ' g user tecdbacV duns g u^e o a computt*- 

mt^Nto w a5n I ^ o 1 

meaissfo dii>j)]a i „ 5 i»> *«cuOj nc t.a"-^k) tlx u^cx to » tevuback 
data^aad 

15 mssasss fer tsscocdmg said feedback data m da& feedb^kmsosidl. 

^ A feedback mtert^ce a\ jccited lu «.k3m b -aherejn smd mc&m tor 
displaying diNflavs a jEnesvage input are.i for said user to mput a text mesMge 
meaas tor display mg acmbsstcs which ths user cm sdect to define the tee^h^k data 

m 

sr^m^ci k muUjjjcsrt ol xrjiv| ienl ked^ i ?■ rx iXnK k >^ \ re ><.^b4,i''^ 

< r smi !. in 1 J I ! \ fit ^ J ^ t 1 5 (. <. n K ht -^i \ k i iox \ 

25 f r \ dei, % I i k n i n « 5 ? j ? uj p c r 

uni<x the bat, m -.t ^ant ^1 1 i u *h user i.\ncne c<.s 

v>tx\m the users co»tc\t asd whercia tUt tv.val * k ^ jo h \ ilaated by a rtsiewer s^ho 

interested m usssr feedback- the method compnssBg mt steps ol: 

idenatvmg the te'Vie^e'"*? \ \tal^UK'>8 preferences, v^herm t c isu^ i/v,tioi 
30 pjcrertn^es tttvluae mdtv,<itJoas ot th(. a mbutc idtnufiers that the re\ srs.*; to 

review: 

filler JhL %eJb*.c5^ reco'^s tn as^coMenee with the M^tiah?auo?i pR-tereju^e** to 
»,reaK « >, b va o a >, ot dv, t'^-^t mciudc^ each of the feedba*. k j^?coid«; havsae ahxjbute 
ice«t5h^ N * to ». r*. W3*htlx \iw^u^tionpt«lereitcfes and 
iS w ( I \ m iis.atki'^ of tk mlx-j ot %;db it, V r vti d fr - b n d set 



1 5 \ jrsetiWu <4S etited in cL ' i K) itmbv f <- "tmpii-.m^ tt>e s s^p» o 
retenmj «t <M ..a ion o* ichan^^c thv. revxev^e.r'N vtstiah/ nion pn?feresce<5 
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rehltcftng tht. ieedOx^cjs. ccurds %% aocordame vitii the t,hajged v^\L,ah/^uot> 
prnfemacevs; and 

dsspkymg ^ mdscaton of the liiimber ot tcc^-ds m tht- tefiile ei combsoei,! s»<?i ma* 
mciude speesfic attribtst© identifiers, 

5 

i ^ A laerijooi as a^c-rcd i.\ cidtvn I i wbe^eis the sJtrsbatc dentifiets 4i« ^ang^u 
Ti*o a p . ral of attrtkite categorje»^ w$> hi; dhwdLty of sm4 atltjbute Kkmsf{s?rs> are 
ar..cg<,tj iu eac i «arbutc carcfoj^, and iu ' it . Jute yenftfter jq each a^nbute cawgoi> 
may be Mored m >.h ijf t 'e r.^uitDlicJU 1 to xi'^.u k Ci, nrd^ 

m 

13, TBstood as feciT.ed m clamx 10 'xnomtx: 

the feedback let, 'iJ-. .'t, «^iani:tJ <.tor<. noi^ us<n ot rSK ts (iC 9 icc t c 
feesiback record wa*. i^dc, ^bosc 'hi. ^ (siJ«ii2a*ion ptti rt^flcs'^ i^nVm w(h\ic di- 
iBdicatK^i of a time range csf .mte-j^st to die rs vtewer; md 
15 tiic feedback iccords «rc ^ aof Cvi j^tote a u&er context descnhing tte ph> &jca} 

iac3t\ u where die asst cimd feedb^ick was made by the use wherem &e ■visualj^aucn 
prefe eac«$ further iaclude an sdicatioa of the ph>:ical k cshm of where the association 
feedbads: was made that of mterest to ths i^viswcr. 

W 14 A method as reo^it.d m dmm 10 wte-etn: 

(he £.{tTshuk' K'e-iafjers are arrxjnged mto a plurai*ty atcnbaic c^ie^unes dna itx i 
one at*ubi' c xi' ndKr ^c<5i,ha«'-3bcfcc*rcs>nTn.n He>.ior>.umc< 4 i- -a. ipl uf-^ o5 
ieedbacK records; 

t5\ .ndsc(i*-jon vi f c tnuuKn ■'t-corcv m tbt cf)mbmeii sc* gfapli.i.aU> di^-^lavs-'a 
25 iri biia <hm .onu aitjibu'^ idejuLter of each record ha% mg m assocjatcd bar graph thai 
mihst »ekcied os de^elecxd, ^d 

the Step oi receivmg a» mdication m ^ change i \ the sows\\s,i - Sviaj/ajor. 
pefwuces meiudes dctenmnmg whes the sekction status of the oa- g^r..ph ..s , - i o* uh 
A jartscalar attrshule "dcuufjcr Ji> changed^ whi-rei when a « <iph a-NOv,s« <:>u v^^th a 
cuiar 'itiijhtJti' jdct^tjfser !b deseVcred, lecords tl at mciude t ja. phr\i^J.,r at^ribrte 
ide itifier are eiimmated trom tht combmed 5«t and %vheri xn when a bar graph aswiated 
sMih a pa ^icukr sttribate identif er sss. selected, rs?eoM& that a ect aii of tlie other cruersa 
wdicated by the vtsuahratio prefereaces aud Inciude the selected atiiibuie jdsntrfier are 
added to tSis combmed set. 

35 

the teedt>av,k records ir& arrajsged sUw vt dtcatton the iiiuc whc . 1 3^ 
f<^dback records created; 



aie visuaikatsori preferences fitrtJssr indudt & tmne x-^age pj^fen-nce sekcsed from a 
pIui-alifY of sdsctabie time raage indjcia fct are IMicative of specific time ranges ami arc 
arranged iso that just one iixm range kidida may be selected at a tiraie; and 

when a panicular dme ninge prnfereijce is selected, records (hat were not abated 
%vithiti ihs time t^oisge indicated by {he selected time mnge prdereace aje eiiminated &om the 
comMaed set aud recoK^s that meet all of the other critena indicated by tlse visuaiixation 
preferences m4 wei» ctsaied within she time range isdjcaied by the selected time range 
preference are added to the comMsed set* 



1 \ tc N % 3 a ! f {or ra US ::i ? « t k i ? i ^ I 

{x.i.orcb'^ 1^ i nsj-d tov Oin mt^ ^T^Uon jnd v-PL-se of ..usiJ-ss. 11 i,\tv^itUn pr Lsi^i 
prouesv or <^rv ce ■when the feedback assoi,j;dted thete^ tb was mad ^ s.^ <.ha. Ktcxi»>tK^ 
i c ludjag * plurality ot aioihwte Ueotif e & thai destifv ttr atate ot iht feeJb^^ k rr Jidc n 
tilt, user the mformatton nd eharactenstiCN a sied m the feedbiv.k bem^^ 
accessible a«d d pia-vabk mdepetsdeotfv t <m ilie prodntt proec-ss or ^er i,^ ttic 
feedback iadudHj;? a ptsrtra\ai ol a n e ?.o mimt at>om the mei s expenejtices m tbe u er 
CO te\t V, thija the product, proce<5N m service, where the kedback is to be e-v Imti^d t>\ 
reti©'«e who is interested a u-sct feedbat.k si-o that the ax lent'- c m pros td hv.i|: to <i I'^^r 
or jmpro\o tbe product proce&s or service tl^ feedback s isu d / voi prssmi. 

filter itJias U> idkn'^c r')c tcvdb.ci rccori s c>r<„U5^t %x i | ^ t -^i 
\iSHaijMtionprtt<.r n<. t. i;. r bi h ' t f ^ hi ^ t,*. ? hi } t 
the feedback txCOiu'- ht i r 1 1 t r'- > u on ^ s s I 

vjsttaiisabois preferences: 

means fo (tj\o1 ^ \ s d i \\ n.<^\ h l m m k in c u n 
char,i.tsrn csottheteta kac <.s ui oiabmed sei, and 

i»eai &. k r i^vj J mi t mctNH iht. spwifted tsual ratios: -jn.kr'^t '-t, Uti a is 
tor receivms cbange^i bet g arranged to ca« e tite fditj tx^s to update tht comb ned set to 
'fleet tbc nt-vi \ <;uaii£ai m pjrfet^nces %l e t a vhaage trcened 

17. A fcvdback ^tsisaftyer a<. rec ted m claim 10 mhcrtia the specsfscd 
!n i \h^^ ^o pa i^r^nu s n Jt! sj. ^c\6 attiihu e k1 nftiei tttd wharem lor each attnbaie 
n - s u cl! t 3 t Ui .J a 1 pre^-^a cc the means ?rd play ng is arranged to 
<^ ^ ) n ajj i jdK at'o-^ oi the ni' nb t * «;.ords m tfie co •ssbiaed set that mciude that pecttiv 
atJnbme identttier. 

\i' A feedback visualizer as recii.&cl i;> churis T? wherein for each deselected 
attftbure iUi\U5t5Cr, tbe displaying Rieans is foither arninged to dixpby &n indication ot ihe 



7 1 

r frf records th»t would he added to ihe comhinted set if that t 



Rofther 



the mean,^ for iftceivisg changes m the specified visuaiixation pi^^fereijoe? includes 
tl of a bar m said hisr chsn ihu5 n a.-isooiated 
ihe $tat»s of a bar m said foa? ctet is 
$arecijangedma 



20. A 



records are arraaged to <siore ais indscatso^ of rb? tune when 



Ei of a dn)fi range of mi&rssi 



just one to tai3g& Mdida 
^ whesL 8 pajticui^ to rasage isdsck Is 

tkm tmgc indicated by ^ selected time rmg 
set hnd records thaj meet ail of the other catena 

to JbecomHn^^d se5. 



2L A mediodfoi i 
whei^in. ,-.aid feedback ,s> Meiu is used bv at h 
metho^i compr'.Mng the steps of: 

coilectHi^ a feedback item from a tiser while- said ijser is mterfsonig v^'ith sasd 
30 c^nipiaer envimrireent o« a first com|juter system, wlierein said feedback uem inciudes* a 
fa usKf cmmieM about tlie user's experieaces iii prodi^^^^ 
ist ide^itifier indicative of the context of said user wi^jn said 



ivtoa 

35 sepsrrjte tri-srit sa«d sottw&re ptx^gnsm a second cots-ipsHcr system', 

whM said feedback item is iadoded in preferences of said ti-viewer, wherdn saui feedback; 
itctJi is presented iisdcpcsdently of said pjooduct, process or service, sxxd wherein said 



feesJbafe^item is^e^^ impxsve said swiewer's tewledge oSiselp 

require^ % the mfxm m^mY&xmntr^Mmi witMn mIjI prwi«ct> proojss, of semee, 

22, A method as lecited ia daim 21 wherdtn: 

S said step of coHcctisg said feedback item includes providtag a ^luraij^ of atmhme 

eategones tor Si«d feedback item from 'a-hjch sajd Q'Jer casi assign atinbutcj- to tlie feedback 
Item; 

|5re5.eaUrg s.ud tvedhack item to s»did reviewer accorojn^ to viil. pse.ei;c''Jve 
seiectioijs wte said feedback item jnckded in said pMereaee seJscftons. 

23. A system for sTnplementmg user feedback used b> at least om? user ^d at least 
15 one reviewei;, ti^c system compmrngt 

meajis for dispJajiag a feedback interface m xcspoase to a received enter feedback 

means for ccHecting tVedbacjc data entered m said feedback tnterface hy a u&es, 
Mbs-c S3jd feedback data Includes a context identifier ido»tifym^ a context of said user 
20 thin ? \H 'duel, pioces*^, or service whes said feedback dau. is coJeaci,' herein 
ib< "> dara mcUidesj a portrayal of a u^er comme-d aboin i-<.is\ -\pe. isiices m 
< -5 < > ( ?t V V ithic saiJ padUvt, pr^xre^s, or service, wlicmn sajd feedback datA sfe to bi. 
v^v< >i i'^ >^ >.' J*. Vies" erwhu is ,n.«av'rii ' said feedback data to provide liclp to the «<!et 
or irrprou vi( i ps<x moctsi k suvs^e 

r;;:\ii^ k^r O(gans^50g saisJ fccdbdck dat.^ .iC^ord^s^g p^ctcavc^i. oi a jevjsf'Aer, 
means foj dti^pkysnj; &aid orgam^ed feedback data jn said viewmg lat&fface 

mdcpendetuly of s^ajd product, process, or smlcc when said feedback data is included m 

said pret^reaces of said reysewer. 

24 A j^ystens a& recited in cUim 23 wherein said means for or$mxzm^ said 
feedbaak <.lita mcltsdes means for calculating a eombitis^d set of feedback records based 
«pot^ iusd re\ sev^e- prelere£>ce6, herein -^asd combified set inclisdej; all feedback recostii* 
j.n ir^g . u ibi t f n-*crrci -iv ^ i ^ rex ^nvu , wherein each of smd plurality of feedbacic 
35 recoms j»cl«de& tiie sajrie atfxtbute categories. 
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